Apr 14 13:08:08 user nova-compute[72019]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 14 13:08:11 user nova-compute[72019]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72019) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72019) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72019) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 13:08:11 user nova-compute[72019]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:08:11 user nova-compute[72019]: INFO nova.virt.driver [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 14 13:08:11 user nova-compute[72019]: INFO nova.compute.provider_config [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] Acquiring lock "singleton_lock" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] Acquired lock "singleton_lock" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] Releasing lock "singleton_lock" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] Full set of CONF: {{(pid=72019) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ******************************************************************************** {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] Configuration options gathered from: {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ================================================================================ {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] allow_resize_to_same_host      = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] arq_binding_timeout            = 300 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] backdoor_port                  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] backdoor_socket                = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] block_device_allocate_retries  = 300 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] block_device_allocate_retries_interval = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cert                           = self.pem {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] compute_monitors               = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] config_dir                     = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] config_drive_format            = iso9660 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] config_source                  = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] console_host                   = user {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] control_exchange               = nova {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cpu_allocation_ratio           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] daemon                         = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] debug                          = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] default_access_ip_network_name = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] default_availability_zone      = nova {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] default_ephemeral_format       = ext4 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] default_schedule_zone          = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] disk_allocation_ratio          = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] enable_new_services            = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] enabled_apis                   = ['osapi_compute'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] enabled_ssl_apis               = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] flat_injected                  = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] force_config_drive             = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] force_raw_images               = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] graceful_shutdown_timeout      = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] heal_instance_info_cache_interval = 60 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] host                           = user {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] instance_build_timeout         = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] instance_delete_interval       = 300 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] instance_format                = [instance: %(uuid)s]  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] instance_name_template         = instance-%08x {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] instance_usage_audit           = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] instance_usage_audit_period    = month {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] internal_service_availability_zone = internal {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] key                            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] live_migration_retry_count     = 30 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] log_config_append              = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] log_dir                        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] log_file                       = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] log_options                    = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] log_rotate_interval            = 1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] log_rotate_interval_type       = days {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] log_rotation_type              = none {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] long_rpc_timeout               = 1800 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] max_concurrent_builds          = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] max_concurrent_live_migrations = 1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] max_concurrent_snapshots       = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] max_local_block_devices        = 3 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] max_logfile_count              = 30 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] max_logfile_size_mb            = 200 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] maximum_instance_delete_attempts = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] metadata_listen                = 0.0.0.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] metadata_listen_port           = 8775 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] metadata_workers               = 3 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] migrate_max_retries            = -1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] mkisofs_cmd                    = genisoimage {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] my_ip                          = 10.0.0.210 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] network_allocate_retries       = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] osapi_compute_listen_port      = 8774 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] osapi_compute_unique_server_name_scope =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] osapi_compute_workers          = 3 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] password_length                = 12 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] periodic_enable                = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] periodic_fuzzy_delay           = 60 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] pointer_model                  = ps2mouse {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] preallocate_images             = none {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] publish_errors                 = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] pybasedir                      = /opt/stack/nova {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ram_allocation_ratio           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] rate_limit_burst               = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] rate_limit_except_level        = CRITICAL {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] rate_limit_interval            = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] reboot_timeout                 = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] reclaim_instance_interval      = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] record                         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] reimage_timeout_per_gb         = 20 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] report_interval                = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] rescue_timeout                 = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] reserved_host_cpus             = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] reserved_host_disk_mb          = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] reserved_host_memory_mb        = 512 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] reserved_huge_pages            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] resize_confirm_window          = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] resize_fs_using_block_device   = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] resume_guests_state_on_host_boot = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] rpc_response_timeout           = 60 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] run_external_periodic_tasks    = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] running_deleted_instance_action = reap {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] running_deleted_instance_poll_interval = 1800 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] running_deleted_instance_timeout = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] scheduler_instance_sync_interval = 120 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] service_down_time              = 60 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] servicegroup_driver            = db {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] shelved_offload_time           = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] shelved_poll_interval          = 3600 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] shutdown_timeout               = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] source_is_ipv6                 = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ssl_only                       = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] state_path                     = /opt/stack/data/nova {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] sync_power_state_interval      = 600 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] sync_power_state_pool_size     = 1000 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] syslog_log_facility            = LOG_USER {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] tempdir                        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] timeout_nbd                    = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] transport_url                  = **** {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] update_resources_interval      = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] use_cow_images                 = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] use_eventlog                   = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] use_journal                    = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] use_json                       = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] use_rootwrap_daemon            = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] use_stderr                     = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] use_syslog                     = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vcpu_pin_set                   = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vif_plugging_is_fatal          = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vif_plugging_timeout           = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] virt_mkfs                      = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] volume_usage_poll_interval     = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] watch_log_file                 = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] web                            = /usr/share/spice-html5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_concurrency.disable_process_locking = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.auth_strategy              = keystone {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.compute_link_prefix        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.dhcp_domain                = novalocal {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.enable_instance_password   = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.glance_link_prefix         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.instance_list_per_project_cells = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.list_records_by_skipping_down_cells = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.local_metadata_per_cell    = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.max_limit                  = 1000 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.metadata_cache_expiration  = 15 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.neutron_default_tenant_id  = default {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.use_forwarded_for          = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.use_neutron_default_nets   = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.vendordata_dynamic_targets = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.vendordata_jsonfile_path   = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.backend                  = dogpile.cache.memcached {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.backend_argument         = **** {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.config_prefix            = cache.oslo {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.dead_timeout             = 60.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.debug_cache_backend      = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.enable_retry_client      = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.enable_socket_keepalive  = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.enabled                  = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.expiration_time          = 600 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.hashclient_retry_attempts = 2 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.memcache_dead_retry      = 300 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.memcache_password        =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.memcache_pool_maxsize    = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.memcache_sasl_enabled    = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.memcache_username        =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.proxies                  = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.retry_attempts           = 2 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.retry_delay              = 0.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.socket_keepalive_count   = 1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.socket_keepalive_idle    = 1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.socket_keepalive_interval = 1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.tls_allowed_ciphers      = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.tls_cafile               = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.tls_certfile             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.tls_enabled              = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cache.tls_keyfile              = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.auth_section            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.auth_type               = password {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.cafile                  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.certfile                = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.collect_timing          = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.cross_az_attach         = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.debug                   = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.endpoint_template       = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.http_retries            = 3 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.insecure                = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.keyfile                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.os_region_name          = RegionOne {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.split_loggers           = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cinder.timeout                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] compute.cpu_dedicated_set      = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] compute.cpu_shared_set         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] compute.image_type_exclude_list = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] compute.max_concurrent_disk_ops = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] compute.max_disk_devices_to_attach = -1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] compute.resource_provider_association_refresh = 300 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] compute.shutdown_retry_interval = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] conductor.workers              = 3 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] console.allowed_origins        = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] console.ssl_ciphers            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] console.ssl_minimum_version    = default {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] consoleauth.token_ttl          = 600 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.cafile                  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.certfile                = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.collect_timing          = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.connect_retries         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.connect_retry_delay     = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.endpoint_override       = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.insecure                = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.keyfile                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.max_version             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.min_version             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.region_name             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.service_name            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.service_type            = accelerator {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.split_loggers           = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.status_code_retries     = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.status_code_retry_delay = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.timeout                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] cyborg.version                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.backend               = sqlalchemy {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.connection            = **** {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.connection_debug      = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.connection_parameters =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.connection_recycle_time = 3600 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.connection_trace      = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.db_inc_retry_interval = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.db_max_retries        = 20 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.db_max_retry_interval = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.db_retry_interval     = 1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.max_overflow          = 50 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.max_pool_size         = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.max_retries           = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.mysql_enable_ndb      = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.mysql_wsrep_sync_wait = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.pool_timeout          = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.retry_interval        = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.slave_connection      = **** {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] database.sqlite_synchronous    = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.backend           = sqlalchemy {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.connection        = **** {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.connection_debug  = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.connection_parameters =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.connection_recycle_time = 3600 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.connection_trace  = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.db_inc_retry_interval = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.db_max_retries    = 20 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.db_max_retry_interval = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.db_retry_interval = 1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.max_overflow      = 50 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.max_pool_size     = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.max_retries       = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.mysql_enable_ndb  = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.pool_timeout      = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.retry_interval    = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:11 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.slave_connection  = **** {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] api_database.sqlite_synchronous = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] devices.enabled_mdev_types     = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ephemeral_storage_encryption.enabled = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.api_servers             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.cafile                  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.certfile                = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.collect_timing          = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.connect_retries         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.connect_retry_delay     = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.debug                   = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.default_trusted_certificate_ids = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.enable_certificate_validation = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.enable_rbd_download     = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.endpoint_override       = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.insecure                = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.keyfile                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.max_version             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.min_version             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.num_retries             = 3 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.rbd_ceph_conf           =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.rbd_connect_timeout     = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.rbd_pool                =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.rbd_user                =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.region_name             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.service_name            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.service_type            = image {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.split_loggers           = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.status_code_retries     = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.status_code_retry_delay = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.timeout                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.verify_glance_signatures = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] glance.version                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] guestfs.debug                  = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.config_drive_cdrom      = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.config_drive_inject_password = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.enable_instance_metrics_collection = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.enable_remotefx         = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.instances_path_share    =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.iscsi_initiator_list    = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.limit_cpu_features      = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.power_state_check_timeframe = 60 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.use_multipath_io        = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.volume_attach_retry_count = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.vswitch_name            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] mks.enabled                    = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] image_cache.manager_interval   = 2400 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] image_cache.precache_concurrency = 1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] image_cache.remove_unused_base_images = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] image_cache.subdirectory_name  = _base {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.api_max_retries         = 60 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.api_retry_interval      = 2 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.auth_section            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.auth_type               = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.cafile                  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.certfile                = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.collect_timing          = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.connect_retries         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.connect_retry_delay     = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.endpoint_override       = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.insecure                = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.keyfile                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.max_version             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.min_version             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.partition_key           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.peer_list               = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.region_name             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.serial_console_state_timeout = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.service_name            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.service_type            = baremetal {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.split_loggers           = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.status_code_retries     = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.status_code_retry_delay = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.timeout                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ironic.version                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] key_manager.fixed_key          = **** {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.barbican_api_version  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.barbican_endpoint     = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.barbican_endpoint_type = public {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.barbican_region_name  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.cafile                = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.certfile              = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.collect_timing        = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.insecure              = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.keyfile               = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.number_of_retries     = 60 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.retry_delay           = 1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.send_service_user_token = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.split_loggers         = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.timeout               = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.verify_ssl            = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican.verify_ssl_path       = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican_service_user.auth_section = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican_service_user.auth_type = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican_service_user.cafile   = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican_service_user.certfile = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican_service_user.collect_timing = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican_service_user.insecure = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican_service_user.keyfile  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican_service_user.split_loggers = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] barbican_service_user.timeout  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.approle_role_id          = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.approle_secret_id        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.cafile                   = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.certfile                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.collect_timing           = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.insecure                 = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.keyfile                  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.kv_mountpoint            = secret {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.kv_version               = 2 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.namespace                = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.root_token_id            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.split_loggers            = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.ssl_ca_crt_file          = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.timeout                  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.use_ssl                  = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.cafile                = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.certfile              = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.collect_timing        = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.connect_retries       = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.connect_retry_delay   = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.endpoint_override     = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.insecure              = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.keyfile               = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.max_version           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.min_version           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.region_name           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.service_name          = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.service_type          = identity {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.split_loggers         = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.status_code_retries   = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.status_code_retry_delay = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.timeout               = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] keystone.version               = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.connection_uri         =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.cpu_mode               = custom {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: WARNING oslo_config.cfg [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.cpu_power_governor_high = performance {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.cpu_power_governor_low = powersave {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.cpu_power_management   = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.device_detach_attempts = 8 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.device_detach_timeout  = 20 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.disk_cachemodes        = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.disk_prefix            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.enabled_perf_events    = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.file_backed_memory     = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.gid_maps               = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.hw_disk_discard        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.hw_machine_type        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.images_rbd_glance_store_name =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.images_rbd_pool        = rbd {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.images_type            = default {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.images_volume_group    = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.inject_key             = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.inject_partition       = -2 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.inject_password        = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.iscsi_iface            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.iser_use_multipath     = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.live_migration_bandwidth = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.live_migration_downtime = 500 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.live_migration_inbound_addr = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.live_migration_permit_post_copy = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.live_migration_scheme  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.live_migration_timeout_action = abort {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.live_migration_tunnelled = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: WARNING oslo_config.cfg [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 14 13:08:12 user nova-compute[72019]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 14 13:08:12 user nova-compute[72019]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 14 13:08:12 user nova-compute[72019]: and ``live_migration_inbound_addr`` respectively.
Apr 14 13:08:12 user nova-compute[72019]: ).  Its value may be silently ignored in the future.
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.live_migration_with_native_tls = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.max_queues             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.nfs_mount_options      = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.num_memory_encrypted_guests = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.num_pcie_ports         = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.pmem_namespaces        = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.quobyte_client_cfg     = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.rbd_secret_uuid        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.rbd_user               = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.remote_filesystem_transport = ssh {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.rescue_image_id        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.rescue_kernel_id       = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.rescue_ramdisk_id      = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.rx_queue_size          = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.smbfs_mount_options    =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.snapshot_compression   = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.snapshot_image_format  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.sparse_logical_volumes = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.swtpm_enabled          = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.swtpm_group            = tss {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.swtpm_user             = tss {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.sysinfo_serial         = unique {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.tx_queue_size          = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.uid_maps               = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.use_virtio_for_bridges = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.virt_type              = kvm {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.volume_clear           = zero {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.volume_clear_size      = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.volume_use_multipath   = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.vzstorage_cache_path   = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.vzstorage_mount_user   = stack {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.auth_section           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.auth_type              = password {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.cafile                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.certfile               = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.collect_timing         = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.connect_retries        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.connect_retry_delay    = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.default_floating_pool  = public {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.endpoint_override      = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.extension_sync_interval = 600 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.http_retries           = 3 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.insecure               = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.keyfile                = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.max_version            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.min_version            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.ovs_bridge             = br-int {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.physnets               = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.region_name            = RegionOne {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.service_metadata_proxy = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.service_name           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.service_type           = network {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.split_loggers          = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.status_code_retries    = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.status_code_retry_delay = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.timeout                = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] neutron.version                = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] notifications.bdms_in_notifications = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] notifications.default_level    = INFO {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] notifications.notification_format = unversioned {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] notifications.notify_on_state_change = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] pci.alias                      = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] pci.device_spec                = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] pci.report_in_placement        = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.auth_section         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.auth_type            = password {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.cafile               = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.certfile             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.collect_timing       = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.connect_retries      = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.connect_retry_delay  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.default_domain_id    = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.default_domain_name  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.domain_id            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.domain_name          = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.endpoint_override    = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.insecure             = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.keyfile              = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.max_version          = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.min_version          = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.password             = **** {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.project_domain_id    = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.project_domain_name  = Default {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.project_id           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.project_name         = service {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.region_name          = RegionOne {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.service_name         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.service_type         = placement {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.split_loggers        = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.status_code_retries  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.status_code_retry_delay = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.system_scope         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.timeout              = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.trust_id             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.user_domain_id       = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.user_domain_name     = Default {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.user_id              = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.username             = placement {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] placement.version              = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] quota.cores                    = 20 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] quota.count_usage_from_placement = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] quota.injected_file_content_bytes = 10240 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] quota.injected_file_path_length = 255 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] quota.injected_files           = 5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] quota.instances                = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] quota.key_pairs                = 100 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] quota.metadata_items           = 128 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] quota.ram                      = 51200 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] quota.recheck_quota            = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] quota.server_group_members     = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] quota.server_groups            = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] rdp.enabled                    = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] scheduler.image_metadata_prefilter = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] scheduler.max_attempts         = 3 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] scheduler.max_placement_results = 1000 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] scheduler.query_placement_for_availability_zone = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] scheduler.query_placement_for_image_type_support = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] scheduler.workers              = 3 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.host_subset_size = 1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.isolated_hosts = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.isolated_images = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.pci_in_placement = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.track_instance_changes = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] metrics.required               = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] metrics.weight_multiplier      = 1.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] metrics.weight_setting         = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] serial_console.enabled         = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] serial_console.port_range      = 10000:20000 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] serial_console.serialproxy_port = 6083 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] service_user.auth_section      = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] service_user.auth_type         = password {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] service_user.cafile            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] service_user.certfile          = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] service_user.collect_timing    = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] service_user.insecure          = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] service_user.keyfile           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] service_user.send_service_user_token = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] service_user.split_loggers     = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] service_user.timeout           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] spice.agent_enabled            = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] spice.enabled                  = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] spice.html5proxy_port          = 6082 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] spice.image_compression        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] spice.jpeg_compression         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] spice.playback_compression     = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] spice.server_listen            = 127.0.0.1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] spice.streaming_mode           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] spice.zlib_compression         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] upgrade_levels.baseapi         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] upgrade_levels.cert            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] upgrade_levels.compute         = auto {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] upgrade_levels.conductor       = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] upgrade_levels.scheduler       = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vendordata_dynamic_auth.auth_section = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vendordata_dynamic_auth.auth_type = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vendordata_dynamic_auth.cafile = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vendordata_dynamic_auth.certfile = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vendordata_dynamic_auth.insecure = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vendordata_dynamic_auth.keyfile = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vendordata_dynamic_auth.timeout = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.api_retry_count         = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.ca_file                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.cache_prefix            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.cluster_name            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.connection_pool_size    = 10 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.console_delay_seconds   = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.datastore_regex         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.host_ip                 = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.host_password           = **** {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.host_port               = 443 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.host_username           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.insecure                = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.integration_bridge      = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.maximum_objects         = 100 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.pbm_default_policy      = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.pbm_enabled             = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.pbm_wsdl_location       = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.serial_port_proxy_uri   = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.serial_port_service_uri = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.task_poll_interval      = 0.5 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.use_linked_clone        = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.vnc_keymap              = en-us {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.vnc_port                = 5900 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vmware.vnc_port_total          = 10000 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vnc.auth_schemes               = ['none'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vnc.enabled                    = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vnc.novncproxy_port            = 6080 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vnc.server_listen              = 0.0.0.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vnc.vencrypt_ca_certs          = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vnc.vencrypt_client_cert       = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vnc.vencrypt_client_key        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.disable_rootwrap   = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.enable_numa_live_migration = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.libvirt_disable_apic = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] wsgi.client_socket_timeout     = 900 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] wsgi.default_pool_size         = 1000 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] wsgi.keep_alive                = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] wsgi.max_header_line           = 16384 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] wsgi.ssl_ca_file               = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] wsgi.ssl_cert_file             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] wsgi.ssl_key_file              = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] wsgi.tcp_keepidle              = 600 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] zvm.ca_file                    = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] zvm.cloud_connector_url        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] zvm.reachable_timeout          = 300 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_policy.enforce_new_defaults = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_policy.enforce_scope      = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_policy.policy_default_rule = default {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_policy.policy_file        = policy.yaml {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] profiler.connection_string     = messaging:// {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] profiler.enabled               = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] profiler.es_doc_type           = notification {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] profiler.es_scroll_size        = 10000 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] profiler.es_scroll_time        = 2m {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] profiler.filter_error_trace    = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] profiler.hmac_keys             = SECRET_KEY {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] profiler.sentinel_service_name = mymaster {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] profiler.socket_timeout        = 0.1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] profiler.trace_sqlalchemy      = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] remote_debug.host              = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] remote_debug.port              = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.ssl      = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_notifications.retry = -1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_messaging_notifications.transport_url = **** {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.auth_section        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.auth_type           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.cafile              = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.certfile            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.collect_timing      = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.connect_retries     = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.connect_retry_delay = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.endpoint_id         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.endpoint_override   = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.insecure            = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.keyfile             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.max_version         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.min_version         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.region_name         = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.service_name        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.service_type        = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.split_loggers       = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.status_code_retries = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.status_code_retry_delay = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.timeout             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.valid_interfaces    = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_limit.version             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_reports.file_event_handler = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] oslo_reports.log_dir           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vif_plug_ovs_privileged.group  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] vif_plug_ovs_privileged.user   = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_vif_linux_bridge.flat_interface = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_vif_ovs.isolate_vif         = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_vif_ovs.per_port_bridge     = False {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] os_brick.lock_path             = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] privsep_osbrick.capabilities   = [21] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] privsep_osbrick.group          = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] privsep_osbrick.helper_command = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] privsep_osbrick.user           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] nova_sys_admin.group           = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] nova_sys_admin.helper_command  = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] nova_sys_admin.user            = None {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG oslo_service.service [None req-82ffde04-7cc4-4ffc-ac17-c57c051bf7ba None None] ******************************************************************************** {{(pid=72019) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 14 13:08:12 user nova-compute[72019]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 14 13:08:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Starting native event thread {{(pid=72019) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Starting green dispatch thread {{(pid=72019) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Starting connection event dispatch thread {{(pid=72019) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Connecting to libvirt: qemu:///system {{(pid=72019) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7498bbe650> {{(pid=72019) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 14 13:08:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7498bbe650> {{(pid=72019) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 14 13:08:12 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Connection event '1' reason 'None'
Apr 14 13:08:12 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 13:08:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.mount [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Initialising _HostMountState generation 0 {{(pid=72019) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 14 13:08:19 user nova-compute[72019]: INFO nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Libvirt host capabilities <capabilities>
Apr 14 13:08:19 user nova-compute[72019]:   <host>
Apr 14 13:08:19 user nova-compute[72019]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 14 13:08:19 user nova-compute[72019]:     <cpu>
Apr 14 13:08:19 user nova-compute[72019]:       <arch>x86_64</arch>
Apr 14 13:08:19 user nova-compute[72019]:       <model>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <vendor>Intel</vendor>
Apr 14 13:08:19 user nova-compute[72019]:       <microcode version='1070'/>
Apr 14 13:08:19 user nova-compute[72019]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 14 13:08:19 user nova-compute[72019]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature name='ss'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature name='vmx'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature name='pcid'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature name='osxsave'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature name='hypervisor'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature name='arat'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature name='tsc_adjust'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature name='md-clear'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature name='stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature name='arch-capabilities'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature name='ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature name='invtsc'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature name='rsba'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature name='skip-l1dfl-vmentry'/>
Apr 14 13:08:19 user nova-compute[72019]:       <pages unit='KiB' size='4'/>
Apr 14 13:08:19 user nova-compute[72019]:       <pages unit='KiB' size='2048'/>
Apr 14 13:08:19 user nova-compute[72019]:     </cpu>
Apr 14 13:08:19 user nova-compute[72019]:     <power_management>
Apr 14 13:08:19 user nova-compute[72019]:       <suspend_mem/>
Apr 14 13:08:19 user nova-compute[72019]:       <suspend_disk/>
Apr 14 13:08:19 user nova-compute[72019]:       <suspend_hybrid/>
Apr 14 13:08:19 user nova-compute[72019]:     </power_management>
Apr 14 13:08:19 user nova-compute[72019]:     <iommu support='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     <migration_features>
Apr 14 13:08:19 user nova-compute[72019]:       <live/>
Apr 14 13:08:19 user nova-compute[72019]:       <uri_transports>
Apr 14 13:08:19 user nova-compute[72019]:         <uri_transport>tcp</uri_transport>
Apr 14 13:08:19 user nova-compute[72019]:         <uri_transport>rdma</uri_transport>
Apr 14 13:08:19 user nova-compute[72019]:       </uri_transports>
Apr 14 13:08:19 user nova-compute[72019]:     </migration_features>
Apr 14 13:08:19 user nova-compute[72019]:     <topology>
Apr 14 13:08:19 user nova-compute[72019]:       <cells num='2'>
Apr 14 13:08:19 user nova-compute[72019]:         <cell id='0'>
Apr 14 13:08:19 user nova-compute[72019]:           <memory unit='KiB'>8189224</memory>
Apr 14 13:08:19 user nova-compute[72019]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 14 13:08:19 user nova-compute[72019]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 13:08:19 user nova-compute[72019]:           <distances>
Apr 14 13:08:19 user nova-compute[72019]:             <sibling id='0' value='10'/>
Apr 14 13:08:19 user nova-compute[72019]:             <sibling id='1' value='20'/>
Apr 14 13:08:19 user nova-compute[72019]:           </distances>
Apr 14 13:08:19 user nova-compute[72019]:           <cpus num='6'>
Apr 14 13:08:19 user nova-compute[72019]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 14 13:08:19 user nova-compute[72019]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 14 13:08:19 user nova-compute[72019]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 14 13:08:19 user nova-compute[72019]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 14 13:08:19 user nova-compute[72019]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 14 13:08:19 user nova-compute[72019]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 14 13:08:19 user nova-compute[72019]:           </cpus>
Apr 14 13:08:19 user nova-compute[72019]:         </cell>
Apr 14 13:08:19 user nova-compute[72019]:         <cell id='1'>
Apr 14 13:08:19 user nova-compute[72019]:           <memory unit='KiB'>8218764</memory>
Apr 14 13:08:19 user nova-compute[72019]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 14 13:08:19 user nova-compute[72019]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 13:08:19 user nova-compute[72019]:           <distances>
Apr 14 13:08:19 user nova-compute[72019]:             <sibling id='0' value='20'/>
Apr 14 13:08:19 user nova-compute[72019]:             <sibling id='1' value='10'/>
Apr 14 13:08:19 user nova-compute[72019]:           </distances>
Apr 14 13:08:19 user nova-compute[72019]:           <cpus num='6'>
Apr 14 13:08:19 user nova-compute[72019]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 14 13:08:19 user nova-compute[72019]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 14 13:08:19 user nova-compute[72019]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 14 13:08:19 user nova-compute[72019]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 14 13:08:19 user nova-compute[72019]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 14 13:08:19 user nova-compute[72019]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 14 13:08:19 user nova-compute[72019]:           </cpus>
Apr 14 13:08:19 user nova-compute[72019]:         </cell>
Apr 14 13:08:19 user nova-compute[72019]:       </cells>
Apr 14 13:08:19 user nova-compute[72019]:     </topology>
Apr 14 13:08:19 user nova-compute[72019]:     <cache>
Apr 14 13:08:19 user nova-compute[72019]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 14 13:08:19 user nova-compute[72019]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 14 13:08:19 user nova-compute[72019]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 14 13:08:19 user nova-compute[72019]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 14 13:08:19 user nova-compute[72019]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 14 13:08:19 user nova-compute[72019]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 14 13:08:19 user nova-compute[72019]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 14 13:08:19 user nova-compute[72019]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 14 13:08:19 user nova-compute[72019]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 14 13:08:19 user nova-compute[72019]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 14 13:08:19 user nova-compute[72019]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 14 13:08:19 user nova-compute[72019]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 14 13:08:19 user nova-compute[72019]:     </cache>
Apr 14 13:08:19 user nova-compute[72019]:     <secmodel>
Apr 14 13:08:19 user nova-compute[72019]:       <model>apparmor</model>
Apr 14 13:08:19 user nova-compute[72019]:       <doi>0</doi>
Apr 14 13:08:19 user nova-compute[72019]:     </secmodel>
Apr 14 13:08:19 user nova-compute[72019]:     <secmodel>
Apr 14 13:08:19 user nova-compute[72019]:       <model>dac</model>
Apr 14 13:08:19 user nova-compute[72019]:       <doi>0</doi>
Apr 14 13:08:19 user nova-compute[72019]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 14 13:08:19 user nova-compute[72019]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 14 13:08:19 user nova-compute[72019]:     </secmodel>
Apr 14 13:08:19 user nova-compute[72019]:   </host>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='alpha'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>64</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>clipper</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='armv6l'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>spitz</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>nuri</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>kzm</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sx1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>z2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>tosa</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>n810</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>n800</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>terrier</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>midway</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>microbit</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>verdex</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>highbank</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>akita</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>connex</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>collie</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='armv7l'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>spitz</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>nuri</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>kzm</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sx1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>z2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>tosa</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>n810</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>n800</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>terrier</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>midway</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>microbit</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>verdex</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>highbank</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>akita</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>connex</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>collie</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='aarch64'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>64</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>spitz</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>nuri</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>kzm</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sx1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>z2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>tosa</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>n810</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>n800</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>terrier</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>midway</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>microbit</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>verdex</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>raspi3b</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>highbank</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>akita</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>connex</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>collie</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <acpi default='on' toggle='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='cris'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='i686'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>isapc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>microvm</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='kvm'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <pae/>
Apr 14 13:08:19 user nova-compute[72019]:       <nonpae/>
Apr 14 13:08:19 user nova-compute[72019]:       <acpi default='on' toggle='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:       <apic default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='m68k'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>an5206</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>q800</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>next-cube</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='microblaze'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='microblazeel'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='mips'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='16'>malta</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='mipsel'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='16'>malta</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='mips64'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>64</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='16'>malta</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>pica61</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>magnum</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='mips64el'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>64</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='16'>malta</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>pica61</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>magnum</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='16'>boston</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='ppc'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mac99</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>40p</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>taihu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='ppc64'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>64</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>taihu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>40p</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mac99</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='ppc64le'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>64</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>taihu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>40p</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>mac99</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='riscv32'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='8'>spike</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>opentitan</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='8'>virt</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='riscv64'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>64</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='8'>spike</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>shakti_c</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='8'>virt</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='s390x'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>64</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='sh4'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>shix</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>r2d</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='sh4eb'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>64</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>shix</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>r2d</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='sparc'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>SS-5</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>SS-20</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>LX</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>SS-4</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>SS-10</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>Voyager</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='sparc64'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>64</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sun4u</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>niagara</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>sun4v</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='x86_64'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>64</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='1'>isapc</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>microvm</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='kvm'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <acpi default='on' toggle='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:       <apic default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='xtensa'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>sim</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>kc705</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>ml605</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>virt</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>lx200</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>lx60</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]:   <guest>
Apr 14 13:08:19 user nova-compute[72019]:     <os_type>hvm</os_type>
Apr 14 13:08:19 user nova-compute[72019]:     <arch name='xtensaeb'>
Apr 14 13:08:19 user nova-compute[72019]:       <wordsize>32</wordsize>
Apr 14 13:08:19 user nova-compute[72019]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='4'>sim</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>kc705</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>ml605</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>virt</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>lx200</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>lx60</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 13:08:19 user nova-compute[72019]:       <domain type='qemu'/>
Apr 14 13:08:19 user nova-compute[72019]:     </arch>
Apr 14 13:08:19 user nova-compute[72019]:     <features>
Apr 14 13:08:19 user nova-compute[72019]:       <cpuselection/>
Apr 14 13:08:19 user nova-compute[72019]:       <deviceboot/>
Apr 14 13:08:19 user nova-compute[72019]:       <disksnapshot default='on' toggle='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     </features>
Apr 14 13:08:19 user nova-compute[72019]:   </guest>
Apr 14 13:08:19 user nova-compute[72019]: </capabilities>
Apr 14 13:08:19 user nova-compute[72019]: 
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 14 13:08:19 user nova-compute[72019]: <domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 13:08:19 user nova-compute[72019]:   <domain>kvm</domain>
Apr 14 13:08:19 user nova-compute[72019]:   <machine>pc-q35-jammy</machine>
Apr 14 13:08:19 user nova-compute[72019]:   <arch>i686</arch>
Apr 14 13:08:19 user nova-compute[72019]:   <vcpu max='288'/>
Apr 14 13:08:19 user nova-compute[72019]:   <iothreads supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:   <os supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='firmware'/>
Apr 14 13:08:19 user nova-compute[72019]:     <loader supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>rom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pflash</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='readonly'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>yes</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='secure'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </loader>
Apr 14 13:08:19 user nova-compute[72019]:   </os>
Apr 14 13:08:19 user nova-compute[72019]:   <cpu>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-passthrough' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='hostPassthroughMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='maximum' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='maximumMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>on</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-model' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <vendor>Intel</vendor>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ss'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='vmx'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='pcid'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='hypervisor'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arat'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='umip'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='md-clear'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibpb'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibrs'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='erms'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='lm'/>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='custom' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>qemu64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>qemu32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>phenom</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>n270</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>kvm64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>kvm32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>coreduo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>core2duo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>athlon</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Westmere</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Snowridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Penryn</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G5</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G4</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G1</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Nehalem</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Rome</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Milan</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Dhyana</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cooperlake</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Conroe</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>486</model>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:   </cpu>
Apr 14 13:08:19 user nova-compute[72019]:   <memoryBacking supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='sourceType'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>file</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>anonymous</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>memfd</value>
Apr 14 13:08:19 user nova-compute[72019]:     </enum>
Apr 14 13:08:19 user nova-compute[72019]:   </memoryBacking>
Apr 14 13:08:19 user nova-compute[72019]:   <devices>
Apr 14 13:08:19 user nova-compute[72019]:     <disk supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='diskDevice'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>disk</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cdrom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>floppy</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>lun</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='bus'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>fdc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sata</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </disk>
Apr 14 13:08:19 user nova-compute[72019]:     <graphics supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sdl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vnc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>spice</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egl-headless</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </graphics>
Apr 14 13:08:19 user nova-compute[72019]:     <video supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='modelType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cirrus</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vmvga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>qxl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>none</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>bochs</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>ramfb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </video>
Apr 14 13:08:19 user nova-compute[72019]:     <hostdev supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='mode'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>subsystem</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='startupPolicy'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>default</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>mandatory</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>requisite</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>optional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='subsysType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pci</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='capsType'/>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='pciBackend'/>
Apr 14 13:08:19 user nova-compute[72019]:     </hostdev>
Apr 14 13:08:19 user nova-compute[72019]:     <rng supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>random</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egd</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>builtin</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </rng>
Apr 14 13:08:19 user nova-compute[72019]:     <filesystem supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='driverType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>path</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>handle</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtiofs</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </filesystem>
Apr 14 13:08:19 user nova-compute[72019]:     <tpm supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-tis</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-crb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>passthrough</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>emulator</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </tpm>
Apr 14 13:08:19 user nova-compute[72019]:   </devices>
Apr 14 13:08:19 user nova-compute[72019]:   <features>
Apr 14 13:08:19 user nova-compute[72019]:     <gic supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     <vmcoreinfo supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <genid supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backingStoreInput supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backup supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <sev supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:   </features>
Apr 14 13:08:19 user nova-compute[72019]: </domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:  {{(pid=72019) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 14 13:08:19 user nova-compute[72019]: <domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 13:08:19 user nova-compute[72019]:   <domain>kvm</domain>
Apr 14 13:08:19 user nova-compute[72019]:   <machine>pc-i440fx-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:   <arch>i686</arch>
Apr 14 13:08:19 user nova-compute[72019]:   <vcpu max='255'/>
Apr 14 13:08:19 user nova-compute[72019]:   <iothreads supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:   <os supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='firmware'/>
Apr 14 13:08:19 user nova-compute[72019]:     <loader supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>rom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pflash</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='readonly'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>yes</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='secure'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </loader>
Apr 14 13:08:19 user nova-compute[72019]:   </os>
Apr 14 13:08:19 user nova-compute[72019]:   <cpu>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-passthrough' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='hostPassthroughMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='maximum' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='maximumMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>on</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-model' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <vendor>Intel</vendor>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ss'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='vmx'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='pcid'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='hypervisor'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arat'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='umip'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='md-clear'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibpb'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibrs'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='erms'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='lm'/>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='custom' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>qemu64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>qemu32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>phenom</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>n270</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>kvm64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>kvm32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>coreduo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>core2duo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>athlon</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Westmere</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Snowridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Penryn</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G5</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G4</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G1</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Nehalem</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Rome</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Milan</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Dhyana</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cooperlake</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Conroe</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>486</model>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:   </cpu>
Apr 14 13:08:19 user nova-compute[72019]:   <memoryBacking supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='sourceType'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>file</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>anonymous</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>memfd</value>
Apr 14 13:08:19 user nova-compute[72019]:     </enum>
Apr 14 13:08:19 user nova-compute[72019]:   </memoryBacking>
Apr 14 13:08:19 user nova-compute[72019]:   <devices>
Apr 14 13:08:19 user nova-compute[72019]:     <disk supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='diskDevice'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>disk</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cdrom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>floppy</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>lun</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='bus'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>ide</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>fdc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sata</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </disk>
Apr 14 13:08:19 user nova-compute[72019]:     <graphics supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sdl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vnc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>spice</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egl-headless</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </graphics>
Apr 14 13:08:19 user nova-compute[72019]:     <video supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='modelType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cirrus</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vmvga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>qxl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>none</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>bochs</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>ramfb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </video>
Apr 14 13:08:19 user nova-compute[72019]:     <hostdev supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='mode'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>subsystem</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='startupPolicy'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>default</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>mandatory</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>requisite</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>optional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='subsysType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pci</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='capsType'/>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='pciBackend'/>
Apr 14 13:08:19 user nova-compute[72019]:     </hostdev>
Apr 14 13:08:19 user nova-compute[72019]:     <rng supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>random</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egd</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>builtin</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </rng>
Apr 14 13:08:19 user nova-compute[72019]:     <filesystem supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='driverType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>path</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>handle</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtiofs</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </filesystem>
Apr 14 13:08:19 user nova-compute[72019]:     <tpm supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-tis</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-crb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>passthrough</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>emulator</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </tpm>
Apr 14 13:08:19 user nova-compute[72019]:   </devices>
Apr 14 13:08:19 user nova-compute[72019]:   <features>
Apr 14 13:08:19 user nova-compute[72019]:     <gic supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     <vmcoreinfo supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <genid supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backingStoreInput supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backup supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <sev supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:   </features>
Apr 14 13:08:19 user nova-compute[72019]: </domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:  {{(pid=72019) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 14 13:08:19 user nova-compute[72019]: <domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 13:08:19 user nova-compute[72019]:   <domain>kvm</domain>
Apr 14 13:08:19 user nova-compute[72019]:   <machine>pc-q35-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:   <arch>i686</arch>
Apr 14 13:08:19 user nova-compute[72019]:   <vcpu max='288'/>
Apr 14 13:08:19 user nova-compute[72019]:   <iothreads supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:   <os supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='firmware'/>
Apr 14 13:08:19 user nova-compute[72019]:     <loader supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>rom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pflash</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='readonly'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>yes</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='secure'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </loader>
Apr 14 13:08:19 user nova-compute[72019]:   </os>
Apr 14 13:08:19 user nova-compute[72019]:   <cpu>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-passthrough' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='hostPassthroughMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='maximum' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='maximumMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>on</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-model' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <vendor>Intel</vendor>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ss'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='vmx'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='pcid'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='hypervisor'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arat'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='umip'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='md-clear'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibpb'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibrs'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='erms'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='lm'/>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='custom' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>qemu64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>qemu32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>phenom</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>n270</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>kvm64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>kvm32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>coreduo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>core2duo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>athlon</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Westmere</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Snowridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Penryn</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G5</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G4</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G1</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Nehalem</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Rome</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Milan</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Dhyana</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cooperlake</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Conroe</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>486</model>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:   </cpu>
Apr 14 13:08:19 user nova-compute[72019]:   <memoryBacking supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='sourceType'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>file</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>anonymous</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>memfd</value>
Apr 14 13:08:19 user nova-compute[72019]:     </enum>
Apr 14 13:08:19 user nova-compute[72019]:   </memoryBacking>
Apr 14 13:08:19 user nova-compute[72019]:   <devices>
Apr 14 13:08:19 user nova-compute[72019]:     <disk supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='diskDevice'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>disk</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cdrom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>floppy</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>lun</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='bus'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>fdc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sata</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </disk>
Apr 14 13:08:19 user nova-compute[72019]:     <graphics supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sdl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vnc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>spice</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egl-headless</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </graphics>
Apr 14 13:08:19 user nova-compute[72019]:     <video supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='modelType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cirrus</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vmvga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>qxl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>none</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>bochs</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>ramfb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </video>
Apr 14 13:08:19 user nova-compute[72019]:     <hostdev supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='mode'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>subsystem</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='startupPolicy'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>default</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>mandatory</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>requisite</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>optional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='subsysType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pci</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='capsType'/>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='pciBackend'/>
Apr 14 13:08:19 user nova-compute[72019]:     </hostdev>
Apr 14 13:08:19 user nova-compute[72019]:     <rng supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>random</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egd</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>builtin</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </rng>
Apr 14 13:08:19 user nova-compute[72019]:     <filesystem supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='driverType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>path</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>handle</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtiofs</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </filesystem>
Apr 14 13:08:19 user nova-compute[72019]:     <tpm supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-tis</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-crb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>passthrough</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>emulator</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </tpm>
Apr 14 13:08:19 user nova-compute[72019]:   </devices>
Apr 14 13:08:19 user nova-compute[72019]:   <features>
Apr 14 13:08:19 user nova-compute[72019]:     <gic supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     <vmcoreinfo supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <genid supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backingStoreInput supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backup supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <sev supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:   </features>
Apr 14 13:08:19 user nova-compute[72019]: </domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:  {{(pid=72019) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 14 13:08:19 user nova-compute[72019]: <domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 13:08:19 user nova-compute[72019]:   <domain>kvm</domain>
Apr 14 13:08:19 user nova-compute[72019]:   <machine>pc-i440fx-jammy</machine>
Apr 14 13:08:19 user nova-compute[72019]:   <arch>i686</arch>
Apr 14 13:08:19 user nova-compute[72019]:   <vcpu max='255'/>
Apr 14 13:08:19 user nova-compute[72019]:   <iothreads supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:   <os supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='firmware'/>
Apr 14 13:08:19 user nova-compute[72019]:     <loader supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>rom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pflash</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='readonly'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>yes</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='secure'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </loader>
Apr 14 13:08:19 user nova-compute[72019]:   </os>
Apr 14 13:08:19 user nova-compute[72019]:   <cpu>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-passthrough' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='hostPassthroughMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='maximum' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='maximumMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>on</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-model' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <vendor>Intel</vendor>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ss'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='vmx'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='pcid'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='hypervisor'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arat'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='umip'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='md-clear'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibpb'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibrs'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='erms'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='lm'/>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='custom' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>qemu64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>qemu32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>phenom</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>n270</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>kvm64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>kvm32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>coreduo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>core2duo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>athlon</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Westmere</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Snowridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Penryn</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G5</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G4</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G1</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Nehalem</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Rome</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Milan</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Dhyana</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cooperlake</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Conroe</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>486</model>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:   </cpu>
Apr 14 13:08:19 user nova-compute[72019]:   <memoryBacking supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='sourceType'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>file</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>anonymous</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>memfd</value>
Apr 14 13:08:19 user nova-compute[72019]:     </enum>
Apr 14 13:08:19 user nova-compute[72019]:   </memoryBacking>
Apr 14 13:08:19 user nova-compute[72019]:   <devices>
Apr 14 13:08:19 user nova-compute[72019]:     <disk supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='diskDevice'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>disk</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cdrom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>floppy</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>lun</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='bus'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>ide</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>fdc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sata</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </disk>
Apr 14 13:08:19 user nova-compute[72019]:     <graphics supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sdl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vnc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>spice</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egl-headless</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </graphics>
Apr 14 13:08:19 user nova-compute[72019]:     <video supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='modelType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cirrus</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vmvga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>qxl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>none</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>bochs</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>ramfb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </video>
Apr 14 13:08:19 user nova-compute[72019]:     <hostdev supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='mode'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>subsystem</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='startupPolicy'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>default</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>mandatory</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>requisite</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>optional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='subsysType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pci</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='capsType'/>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='pciBackend'/>
Apr 14 13:08:19 user nova-compute[72019]:     </hostdev>
Apr 14 13:08:19 user nova-compute[72019]:     <rng supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>random</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egd</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>builtin</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </rng>
Apr 14 13:08:19 user nova-compute[72019]:     <filesystem supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='driverType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>path</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>handle</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtiofs</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </filesystem>
Apr 14 13:08:19 user nova-compute[72019]:     <tpm supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-tis</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-crb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>passthrough</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>emulator</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </tpm>
Apr 14 13:08:19 user nova-compute[72019]:   </devices>
Apr 14 13:08:19 user nova-compute[72019]:   <features>
Apr 14 13:08:19 user nova-compute[72019]:     <gic supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     <vmcoreinfo supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <genid supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backingStoreInput supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backup supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <sev supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:   </features>
Apr 14 13:08:19 user nova-compute[72019]: </domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:  {{(pid=72019) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 14 13:08:19 user nova-compute[72019]: <domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 13:08:19 user nova-compute[72019]:   <domain>kvm</domain>
Apr 14 13:08:19 user nova-compute[72019]:   <machine>pc-q35-jammy</machine>
Apr 14 13:08:19 user nova-compute[72019]:   <arch>x86_64</arch>
Apr 14 13:08:19 user nova-compute[72019]:   <vcpu max='288'/>
Apr 14 13:08:19 user nova-compute[72019]:   <iothreads supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:   <os supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='firmware'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>efi</value>
Apr 14 13:08:19 user nova-compute[72019]:     </enum>
Apr 14 13:08:19 user nova-compute[72019]:     <loader supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>rom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pflash</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='readonly'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>yes</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='secure'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>yes</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </loader>
Apr 14 13:08:19 user nova-compute[72019]:   </os>
Apr 14 13:08:19 user nova-compute[72019]:   <cpu>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-passthrough' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='hostPassthroughMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>on</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='maximum' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='maximumMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>on</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-model' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <vendor>Intel</vendor>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ss'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='vmx'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='pcid'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='hypervisor'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arat'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='umip'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='md-clear'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='invtsc'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibpb'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibrs'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='rsba'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='erms'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='custom' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>qemu64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>qemu32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>phenom</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>n270</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>kvm64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>kvm32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>coreduo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>core2duo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>athlon</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Westmere</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Snowridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Penryn</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G5</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G4</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Opteron_G1</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Nehalem</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Rome</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Milan</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Dhyana</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cooperlake</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Conroe</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>486</model>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:   </cpu>
Apr 14 13:08:19 user nova-compute[72019]:   <memoryBacking supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='sourceType'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>file</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>anonymous</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>memfd</value>
Apr 14 13:08:19 user nova-compute[72019]:     </enum>
Apr 14 13:08:19 user nova-compute[72019]:   </memoryBacking>
Apr 14 13:08:19 user nova-compute[72019]:   <devices>
Apr 14 13:08:19 user nova-compute[72019]:     <disk supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='diskDevice'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>disk</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cdrom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>floppy</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>lun</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='bus'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>fdc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sata</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </disk>
Apr 14 13:08:19 user nova-compute[72019]:     <graphics supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sdl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vnc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>spice</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egl-headless</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </graphics>
Apr 14 13:08:19 user nova-compute[72019]:     <video supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='modelType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cirrus</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vmvga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>qxl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>none</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>bochs</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>ramfb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </video>
Apr 14 13:08:19 user nova-compute[72019]:     <hostdev supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='mode'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>subsystem</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='startupPolicy'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>default</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>mandatory</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>requisite</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>optional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='subsysType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pci</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='capsType'/>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='pciBackend'/>
Apr 14 13:08:19 user nova-compute[72019]:     </hostdev>
Apr 14 13:08:19 user nova-compute[72019]:     <rng supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>random</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egd</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>builtin</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </rng>
Apr 14 13:08:19 user nova-compute[72019]:     <filesystem supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='driverType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>path</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>handle</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtiofs</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </filesystem>
Apr 14 13:08:19 user nova-compute[72019]:     <tpm supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-tis</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-crb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>passthrough</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>emulator</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </tpm>
Apr 14 13:08:19 user nova-compute[72019]:   </devices>
Apr 14 13:08:19 user nova-compute[72019]:   <features>
Apr 14 13:08:19 user nova-compute[72019]:     <gic supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     <vmcoreinfo supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <genid supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backingStoreInput supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backup supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <sev supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:   </features>
Apr 14 13:08:19 user nova-compute[72019]: </domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:  {{(pid=72019) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 14 13:08:19 user nova-compute[72019]: <domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 13:08:19 user nova-compute[72019]:   <domain>kvm</domain>
Apr 14 13:08:19 user nova-compute[72019]:   <machine>pc-i440fx-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:   <arch>x86_64</arch>
Apr 14 13:08:19 user nova-compute[72019]:   <vcpu max='255'/>
Apr 14 13:08:19 user nova-compute[72019]:   <iothreads supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:   <os supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='firmware'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>efi</value>
Apr 14 13:08:19 user nova-compute[72019]:     </enum>
Apr 14 13:08:19 user nova-compute[72019]:     <loader supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>rom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pflash</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='readonly'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>yes</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='secure'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </loader>
Apr 14 13:08:19 user nova-compute[72019]:   </os>
Apr 14 13:08:19 user nova-compute[72019]:   <cpu>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-passthrough' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='hostPassthroughMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>on</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='maximum' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='maximumMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>on</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-model' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <vendor>Intel</vendor>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ss'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='vmx'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='pcid'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='hypervisor'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arat'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='umip'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='md-clear'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='invtsc'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibpb'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibrs'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='rsba'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='erms'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='custom' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>qemu64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>qemu32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>phenom</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>n270</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>kvm64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>kvm32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>coreduo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>core2duo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>athlon</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Westmere</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Snowridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Penryn</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G5</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G4</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Opteron_G1</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Nehalem</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Rome</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Milan</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Dhyana</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cooperlake</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Conroe</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>486</model>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:   </cpu>
Apr 14 13:08:19 user nova-compute[72019]:   <memoryBacking supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='sourceType'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>file</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>anonymous</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>memfd</value>
Apr 14 13:08:19 user nova-compute[72019]:     </enum>
Apr 14 13:08:19 user nova-compute[72019]:   </memoryBacking>
Apr 14 13:08:19 user nova-compute[72019]:   <devices>
Apr 14 13:08:19 user nova-compute[72019]:     <disk supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='diskDevice'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>disk</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cdrom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>floppy</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>lun</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='bus'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>ide</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>fdc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sata</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </disk>
Apr 14 13:08:19 user nova-compute[72019]:     <graphics supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sdl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vnc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>spice</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egl-headless</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </graphics>
Apr 14 13:08:19 user nova-compute[72019]:     <video supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='modelType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cirrus</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vmvga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>qxl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>none</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>bochs</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>ramfb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </video>
Apr 14 13:08:19 user nova-compute[72019]:     <hostdev supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='mode'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>subsystem</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='startupPolicy'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>default</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>mandatory</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>requisite</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>optional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='subsysType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pci</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='capsType'/>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='pciBackend'/>
Apr 14 13:08:19 user nova-compute[72019]:     </hostdev>
Apr 14 13:08:19 user nova-compute[72019]:     <rng supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>random</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egd</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>builtin</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </rng>
Apr 14 13:08:19 user nova-compute[72019]:     <filesystem supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='driverType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>path</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>handle</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtiofs</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </filesystem>
Apr 14 13:08:19 user nova-compute[72019]:     <tpm supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-tis</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-crb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>passthrough</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>emulator</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </tpm>
Apr 14 13:08:19 user nova-compute[72019]:   </devices>
Apr 14 13:08:19 user nova-compute[72019]:   <features>
Apr 14 13:08:19 user nova-compute[72019]:     <gic supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     <vmcoreinfo supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <genid supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backingStoreInput supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backup supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <sev supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:   </features>
Apr 14 13:08:19 user nova-compute[72019]: </domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:  {{(pid=72019) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 14 13:08:19 user nova-compute[72019]: <domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 13:08:19 user nova-compute[72019]:   <domain>kvm</domain>
Apr 14 13:08:19 user nova-compute[72019]:   <machine>pc-q35-6.2</machine>
Apr 14 13:08:19 user nova-compute[72019]:   <arch>x86_64</arch>
Apr 14 13:08:19 user nova-compute[72019]:   <vcpu max='288'/>
Apr 14 13:08:19 user nova-compute[72019]:   <iothreads supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:   <os supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='firmware'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>efi</value>
Apr 14 13:08:19 user nova-compute[72019]:     </enum>
Apr 14 13:08:19 user nova-compute[72019]:     <loader supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>rom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pflash</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='readonly'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>yes</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='secure'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>yes</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </loader>
Apr 14 13:08:19 user nova-compute[72019]:   </os>
Apr 14 13:08:19 user nova-compute[72019]:   <cpu>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-passthrough' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='hostPassthroughMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>on</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='maximum' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='maximumMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>on</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-model' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <vendor>Intel</vendor>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ss'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='vmx'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='pcid'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='hypervisor'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arat'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='umip'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='md-clear'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='invtsc'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibpb'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibrs'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='rsba'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='erms'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='custom' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>qemu64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>qemu32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>phenom</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>n270</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>kvm64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>kvm32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>coreduo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>core2duo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>athlon</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Westmere</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Snowridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Penryn</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G5</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G4</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Opteron_G1</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Nehalem</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Rome</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Milan</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Dhyana</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cooperlake</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Conroe</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>486</model>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:   </cpu>
Apr 14 13:08:19 user nova-compute[72019]:   <memoryBacking supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='sourceType'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>file</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>anonymous</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>memfd</value>
Apr 14 13:08:19 user nova-compute[72019]:     </enum>
Apr 14 13:08:19 user nova-compute[72019]:   </memoryBacking>
Apr 14 13:08:19 user nova-compute[72019]:   <devices>
Apr 14 13:08:19 user nova-compute[72019]:     <disk supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='diskDevice'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>disk</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cdrom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>floppy</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>lun</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='bus'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>fdc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sata</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </disk>
Apr 14 13:08:19 user nova-compute[72019]:     <graphics supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sdl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vnc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>spice</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egl-headless</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </graphics>
Apr 14 13:08:19 user nova-compute[72019]:     <video supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='modelType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cirrus</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vmvga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>qxl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>none</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>bochs</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>ramfb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </video>
Apr 14 13:08:19 user nova-compute[72019]:     <hostdev supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='mode'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>subsystem</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='startupPolicy'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>default</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>mandatory</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>requisite</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>optional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='subsysType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pci</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='capsType'/>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='pciBackend'/>
Apr 14 13:08:19 user nova-compute[72019]:     </hostdev>
Apr 14 13:08:19 user nova-compute[72019]:     <rng supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>random</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egd</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>builtin</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </rng>
Apr 14 13:08:19 user nova-compute[72019]:     <filesystem supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='driverType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>path</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>handle</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtiofs</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </filesystem>
Apr 14 13:08:19 user nova-compute[72019]:     <tpm supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-tis</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-crb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>passthrough</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>emulator</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </tpm>
Apr 14 13:08:19 user nova-compute[72019]:   </devices>
Apr 14 13:08:19 user nova-compute[72019]:   <features>
Apr 14 13:08:19 user nova-compute[72019]:     <gic supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     <vmcoreinfo supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <genid supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backingStoreInput supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backup supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <sev supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:   </features>
Apr 14 13:08:19 user nova-compute[72019]: </domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:  {{(pid=72019) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 14 13:08:19 user nova-compute[72019]: <domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 13:08:19 user nova-compute[72019]:   <domain>kvm</domain>
Apr 14 13:08:19 user nova-compute[72019]:   <machine>pc-i440fx-jammy</machine>
Apr 14 13:08:19 user nova-compute[72019]:   <arch>x86_64</arch>
Apr 14 13:08:19 user nova-compute[72019]:   <vcpu max='255'/>
Apr 14 13:08:19 user nova-compute[72019]:   <iothreads supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:   <os supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='firmware'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>efi</value>
Apr 14 13:08:19 user nova-compute[72019]:     </enum>
Apr 14 13:08:19 user nova-compute[72019]:     <loader supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>rom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pflash</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='readonly'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>yes</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='secure'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>no</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </loader>
Apr 14 13:08:19 user nova-compute[72019]:   </os>
Apr 14 13:08:19 user nova-compute[72019]:   <cpu>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-passthrough' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='hostPassthroughMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>on</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='maximum' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='maximumMigratable'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>on</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>off</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='host-model' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <vendor>Intel</vendor>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ss'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='vmx'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='pcid'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='hypervisor'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arat'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='umip'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='md-clear'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='invtsc'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibpb'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='ibrs'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-stibp'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='rsba'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='erms'/>
Apr 14 13:08:19 user nova-compute[72019]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:     <mode name='custom' supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>qemu64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>qemu32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>phenom</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>pentium</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>n270</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>kvm64</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>kvm32</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>coreduo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>core2duo</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>athlon</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Westmere</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Snowridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Skylake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>SandyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Penryn</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G5</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G4</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G3</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Opteron_G2</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Opteron_G1</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Nehalem</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>IvyBridge</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Icelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Haswell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Rome</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-Milan</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>EPYC</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Dhyana</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cooperlake</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>Conroe</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='no'>Broadwell</model>
Apr 14 13:08:19 user nova-compute[72019]:       <model usable='yes'>486</model>
Apr 14 13:08:19 user nova-compute[72019]:     </mode>
Apr 14 13:08:19 user nova-compute[72019]:   </cpu>
Apr 14 13:08:19 user nova-compute[72019]:   <memoryBacking supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:     <enum name='sourceType'>
Apr 14 13:08:19 user nova-compute[72019]:       <value>file</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>anonymous</value>
Apr 14 13:08:19 user nova-compute[72019]:       <value>memfd</value>
Apr 14 13:08:19 user nova-compute[72019]:     </enum>
Apr 14 13:08:19 user nova-compute[72019]:   </memoryBacking>
Apr 14 13:08:19 user nova-compute[72019]:   <devices>
Apr 14 13:08:19 user nova-compute[72019]:     <disk supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='diskDevice'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>disk</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cdrom</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>floppy</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>lun</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='bus'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>ide</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>fdc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sata</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </disk>
Apr 14 13:08:19 user nova-compute[72019]:     <graphics supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='type'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>sdl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vnc</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>spice</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egl-headless</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </graphics>
Apr 14 13:08:19 user nova-compute[72019]:     <video supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='modelType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>cirrus</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>vmvga</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>qxl</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>none</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>bochs</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>ramfb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </video>
Apr 14 13:08:19 user nova-compute[72019]:     <hostdev supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='mode'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>subsystem</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='startupPolicy'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>default</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>mandatory</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>requisite</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>optional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='subsysType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>usb</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>pci</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>scsi</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='capsType'/>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='pciBackend'/>
Apr 14 13:08:19 user nova-compute[72019]:     </hostdev>
Apr 14 13:08:19 user nova-compute[72019]:     <rng supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtio-non-transitional</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>random</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>egd</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>builtin</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </rng>
Apr 14 13:08:19 user nova-compute[72019]:     <filesystem supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='driverType'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>path</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>handle</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>virtiofs</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </filesystem>
Apr 14 13:08:19 user nova-compute[72019]:     <tpm supported='yes'>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='model'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-tis</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>tpm-crb</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:       <enum name='backendModel'>
Apr 14 13:08:19 user nova-compute[72019]:         <value>passthrough</value>
Apr 14 13:08:19 user nova-compute[72019]:         <value>emulator</value>
Apr 14 13:08:19 user nova-compute[72019]:       </enum>
Apr 14 13:08:19 user nova-compute[72019]:     </tpm>
Apr 14 13:08:19 user nova-compute[72019]:   </devices>
Apr 14 13:08:19 user nova-compute[72019]:   <features>
Apr 14 13:08:19 user nova-compute[72019]:     <gic supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:     <vmcoreinfo supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <genid supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backingStoreInput supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <backup supported='yes'/>
Apr 14 13:08:19 user nova-compute[72019]:     <sev supported='no'/>
Apr 14 13:08:19 user nova-compute[72019]:   </features>
Apr 14 13:08:19 user nova-compute[72019]: </domainCapabilities>
Apr 14 13:08:19 user nova-compute[72019]:  {{(pid=72019) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72019) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72019) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Checking secure boot support for host arch (x86_64) {{(pid=72019) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 13:08:19 user nova-compute[72019]: INFO nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Secure Boot support detected
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] cpu compare xml: <cpu match="exact">
Apr 14 13:08:19 user nova-compute[72019]:   <model>Nehalem</model>
Apr 14 13:08:19 user nova-compute[72019]: </cpu>
Apr 14 13:08:19 user nova-compute[72019]:  {{(pid=72019) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 14 13:08:19 user nova-compute[72019]: INFO nova.virt.node [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Generated node identity 9b2bb118-b0e4-40f8-89f7-8051d0c64569
Apr 14 13:08:19 user nova-compute[72019]: INFO nova.virt.node [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Wrote node identity 9b2bb118-b0e4-40f8-89f7-8051d0c64569 to /opt/stack/data/nova/compute_id
Apr 14 13:08:19 user nova-compute[72019]: WARNING nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Compute nodes ['9b2bb118-b0e4-40f8-89f7-8051d0c64569'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 14 13:08:19 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 14 13:08:19 user nova-compute[72019]: WARNING nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 13:08:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:08:19 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:08:20 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:08:20 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Hypervisor/Node resource view: name=user free_ram=10852MB free_disk=27.061172485351562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:08:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:08:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:08:20 user nova-compute[72019]: WARNING nova.compute.resource_tracker [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] No compute node record for user:9b2bb118-b0e4-40f8-89f7-8051d0c64569: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 9b2bb118-b0e4-40f8-89f7-8051d0c64569 could not be found.
Apr 14 13:08:20 user nova-compute[72019]: INFO nova.compute.resource_tracker [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Compute node record created for user:user with uuid: 9b2bb118-b0e4-40f8-89f7-8051d0c64569
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:08:20 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [req-07de2686-8047-42e6-b557-225e91bebcd6] Created resource provider record via placement API for resource provider with UUID 9b2bb118-b0e4-40f8-89f7-8051d0c64569 and name user.
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72019) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 14 13:08:20 user nova-compute[72019]: INFO nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] kernel doesn't support AMD SEV
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Updating inventory in ProviderTree for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Libvirt baseline CPU <cpu>
Apr 14 13:08:20 user nova-compute[72019]:   <arch>x86_64</arch>
Apr 14 13:08:20 user nova-compute[72019]:   <model>Nehalem</model>
Apr 14 13:08:20 user nova-compute[72019]:   <vendor>Intel</vendor>
Apr 14 13:08:20 user nova-compute[72019]:   <topology sockets="6" cores="1" threads="1"/>
Apr 14 13:08:20 user nova-compute[72019]: </cpu>
Apr 14 13:08:20 user nova-compute[72019]:  {{(pid=72019) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Updated inventory for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Updating resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 generation from 0 to 1 during operation: update_inventory {{(pid=72019) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Updating inventory in ProviderTree for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Updating resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 generation from 1 to 2 during operation: update_traits {{(pid=72019) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:08:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.642s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.service [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Creating RPC server for service compute {{(pid=72019) start /opt/stack/nova/nova/service.py:182}}
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.service [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Join ServiceGroup membership for this service compute {{(pid=72019) start /opt/stack/nova/nova/service.py:199}}
Apr 14 13:08:20 user nova-compute[72019]: DEBUG nova.servicegroup.drivers.db [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72019) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 14 13:08:21 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:08:21 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Rebuilding the list of instances to heal {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Didn't find any instances for network info cache update. {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:09:11 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:09:11 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:09:11 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:09:12 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=10211MB free_disk=26.974971771240234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:09:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:09:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:09:12 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:09:12 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:09:12 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:09:12 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:09:12 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:09:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:10:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:10:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:10:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:10:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:10:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:10:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Rebuilding the list of instances to heal {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 13:10:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Didn't find any instances for network info cache update. {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 13:10:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:10:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:10:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:10:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:10:13 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:10:13 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:10:13 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:10:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:10:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:10:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:10:13 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:10:13 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:10:13 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:10:13 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=10186MB free_disk=27.018577575683594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:10:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:10:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:10:14 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:10:14 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:10:14 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:10:14 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:10:14 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:10:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:11:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:11:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:11:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:11:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:11:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Rebuilding the list of instances to heal {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 13:11:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Didn't find any instances for network info cache update. {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 13:11:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:11:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:11:13 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:11:13 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:11:14 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:11:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:11:14 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:11:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:11:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:11:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:11:14 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:11:14 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:11:14 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:11:14 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=10169MB free_disk=26.79705810546875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:11:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:11:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:11:15 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:11:15 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:11:15 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:11:15 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:11:15 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:11:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:12:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:12:12 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:12:13 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:12:14 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:12:14 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:12:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:12:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Rebuilding the list of instances to heal {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 13:12:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Didn't find any instances for network info cache update. {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 13:12:14 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:12:14 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:12:14 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:12:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:12:16 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:12:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:16 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:12:17 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:12:17 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:12:17 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=9386MB free_disk=26.78915786743164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:12:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:17 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:12:17 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:12:17 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:12:17 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:12:17 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:12:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "62e10eb2-a042-4916-8b61-51f7dcd731dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:12:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:12:27 user nova-compute[72019]: INFO nova.compute.claims [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Claim successful on node user
Apr 14 13:12:27 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:12:27 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:12:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:12:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:12:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:12:27 user nova-compute[72019]: DEBUG nova.network.neutron [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:12:28 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:12:28 user nova-compute[72019]: INFO nova.compute.claims [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Claim successful on node user
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:12:28 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Creating image(s)
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "/opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "/opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "/opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d.part --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.network.neutron [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:12:28 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d.part --force-share --output=json" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.virt.images [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] 364f8f0e-9be3-4fd9-80d8-be290e16b4b1 was qcow2, converting to raw {{(pid=72019) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d.part /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d.converted {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:12:28 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Creating image(s)
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "/opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "/opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "/opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d.part /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d.converted" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d.converted --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.policy [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '152f7a419a524915a216130426b32ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d534e4c1cd4abb9204ce53e9a2a7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG nova.policy [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d.converted --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.641s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:28 user nova-compute[72019]: INFO oslo.privsep.daemon [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_9slljc0/privsep.sock']
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.161s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:28 user sudo[80910]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_9slljc0/privsep.sock
Apr 14 13:12:28 user sudo[80910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 13:12:30 user sudo[80910]: pam_unix(sudo:session): session closed for user root
Apr 14 13:12:30 user nova-compute[72019]: INFO oslo.privsep.daemon [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Spawned new privsep daemon via rootwrap
Apr 14 13:12:30 user nova-compute[72019]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 13:12:30 user nova-compute[72019]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 13:12:30 user nova-compute[72019]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 14 13:12:30 user nova-compute[72019]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80913
Apr 14 13:12:30 user nova-compute[72019]: WARNING oslo_privsep.priv_context [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] privsep daemon already running
Apr 14 13:12:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.154s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk 1073741824" returned: 0 in 0.043s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.192s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG nova.network.neutron [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Successfully created port: 2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.179s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.148s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk 1073741824" returned: 0 in 0.053s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Cannot resize image /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG nova.objects.instance [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lazy-loading 'migration_context' on Instance uuid 62e10eb2-a042-4916-8b61-51f7dcd731dd {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Ensure instance console log exists: /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.125s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Cannot resize image /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'migration_context' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Ensure instance console log exists: /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG nova.network.neutron [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Successfully created port: e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:31 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:12:31 user nova-compute[72019]: INFO nova.compute.claims [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Claim successful on node user
Apr 14 13:12:32 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG nova.network.neutron [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:12:32 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:12:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:12:32 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Creating image(s)
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "/opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "/opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "/opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.124s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk 1073741824" returned: 0 in 0.041s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG nova.policy [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.167s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Cannot resize image /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'migration_context' on Instance uuid 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Ensure instance console log exists: /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:33 user nova-compute[72019]: DEBUG nova.network.neutron [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Successfully updated port: 2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:12:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "refresh_cache-62e10eb2-a042-4916-8b61-51f7dcd731dd" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:12:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquired lock "refresh_cache-62e10eb2-a042-4916-8b61-51f7dcd731dd" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:12:33 user nova-compute[72019]: DEBUG nova.network.neutron [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:12:33 user nova-compute[72019]: DEBUG nova.network.neutron [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:12:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Received event network-changed-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Refreshing instance network info cache due to event network-changed-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:12:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] Acquiring lock "refresh_cache-62e10eb2-a042-4916-8b61-51f7dcd731dd" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.network.neutron [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Updating instance_info_cache with network_info: [{"id": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "address": "fa:16:3e:2d:13:e0", "network": {"id": "69762a08-01c9-4ee5-9118-3824b54739c4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721534193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d534e4c1cd4abb9204ce53e9a2a7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2255403b-5b", "ovs_interfaceid": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Releasing lock "refresh_cache-62e10eb2-a042-4916-8b61-51f7dcd731dd" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Instance network_info: |[{"id": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "address": "fa:16:3e:2d:13:e0", "network": {"id": "69762a08-01c9-4ee5-9118-3824b54739c4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721534193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d534e4c1cd4abb9204ce53e9a2a7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2255403b-5b", "ovs_interfaceid": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] Acquired lock "refresh_cache-62e10eb2-a042-4916-8b61-51f7dcd731dd" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.network.neutron [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Refreshing network info cache for port 2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Start _get_guest_xml network_info=[{"id": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "address": "fa:16:3e:2d:13:e0", "network": {"id": "69762a08-01c9-4ee5-9118-3824b54739c4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721534193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d534e4c1cd4abb9204ce53e9a2a7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2255403b-5b", "ovs_interfaceid": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:12:34 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:12:34 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1108872439',display_name='tempest-DeleteServersTestJSON-server-1108872439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1108872439',id=1,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50d534e4c1cd4abb9204ce53e9a2a7b3',ramdisk_id='',reservation_id='r-7omwe66v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1521801319',owner_user_name='tempest-DeleteServersTestJSON-1521801319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:28Z,user_data=None,user_id='152f7a419a524915a216130426b32ea4',uuid=62e10eb2-a042-4916-8b61-51f7dcd731dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "address": "fa:16:3e:2d:13:e0", "network": {"id": "69762a08-01c9-4ee5-9118-3824b54739c4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721534193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d534e4c1cd4abb9204ce53e9a2a7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2255403b-5b", "ovs_interfaceid": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Converting VIF {"id": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "address": "fa:16:3e:2d:13:e0", "network": {"id": "69762a08-01c9-4ee5-9118-3824b54739c4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721534193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d534e4c1cd4abb9204ce53e9a2a7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2255403b-5b", "ovs_interfaceid": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:13:e0,bridge_name='br-int',has_traffic_filtering=True,id=2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74,network=Network(69762a08-01c9-4ee5-9118-3824b54739c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2255403b-5b') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.objects.instance [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lazy-loading 'pci_devices' on Instance uuid 62e10eb2-a042-4916-8b61-51f7dcd731dd {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.network.neutron [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Successfully updated port: e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:12:34 user nova-compute[72019]:   <uuid>62e10eb2-a042-4916-8b61-51f7dcd731dd</uuid>
Apr 14 13:12:34 user nova-compute[72019]:   <name>instance-00000001</name>
Apr 14 13:12:34 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:12:34 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:12:34 user nova-compute[72019]:   <metadata>
Apr 14 13:12:34 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:12:34 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:12:34 user nova-compute[72019]:       <nova:name>tempest-DeleteServersTestJSON-server-1108872439</nova:name>
Apr 14 13:12:34 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:12:34</nova:creationTime>
Apr 14 13:12:34 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:12:34 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:12:34 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:12:34 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:12:34 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:12:34 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:12:34 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:12:34 user nova-compute[72019]:       <nova:owner>
Apr 14 13:12:34 user nova-compute[72019]:         <nova:user uuid="152f7a419a524915a216130426b32ea4">tempest-DeleteServersTestJSON-1521801319-project-member</nova:user>
Apr 14 13:12:34 user nova-compute[72019]:         <nova:project uuid="50d534e4c1cd4abb9204ce53e9a2a7b3">tempest-DeleteServersTestJSON-1521801319</nova:project>
Apr 14 13:12:34 user nova-compute[72019]:       </nova:owner>
Apr 14 13:12:34 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:12:34 user nova-compute[72019]:       <nova:ports>
Apr 14 13:12:34 user nova-compute[72019]:         <nova:port uuid="2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74">
Apr 14 13:12:34 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 13:12:34 user nova-compute[72019]:         </nova:port>
Apr 14 13:12:34 user nova-compute[72019]:       </nova:ports>
Apr 14 13:12:34 user nova-compute[72019]:     </nova:instance>
Apr 14 13:12:34 user nova-compute[72019]:   </metadata>
Apr 14 13:12:34 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:12:34 user nova-compute[72019]:     <system>
Apr 14 13:12:34 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:12:34 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:12:34 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:12:34 user nova-compute[72019]:       <entry name="serial">62e10eb2-a042-4916-8b61-51f7dcd731dd</entry>
Apr 14 13:12:34 user nova-compute[72019]:       <entry name="uuid">62e10eb2-a042-4916-8b61-51f7dcd731dd</entry>
Apr 14 13:12:34 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:12:34 user nova-compute[72019]:     </system>
Apr 14 13:12:34 user nova-compute[72019]:   </sysinfo>
Apr 14 13:12:34 user nova-compute[72019]:   <os>
Apr 14 13:12:34 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:12:34 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:12:34 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:12:34 user nova-compute[72019]:   </os>
Apr 14 13:12:34 user nova-compute[72019]:   <features>
Apr 14 13:12:34 user nova-compute[72019]:     <acpi/>
Apr 14 13:12:34 user nova-compute[72019]:     <apic/>
Apr 14 13:12:34 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:12:34 user nova-compute[72019]:   </features>
Apr 14 13:12:34 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:12:34 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:12:34 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:12:34 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:12:34 user nova-compute[72019]:   </clock>
Apr 14 13:12:34 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:12:34 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:12:34 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:12:34 user nova-compute[72019]:   </cpu>
Apr 14 13:12:34 user nova-compute[72019]:   <devices>
Apr 14 13:12:34 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:12:34 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:12:34 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk"/>
Apr 14 13:12:34 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:12:34 user nova-compute[72019]:     </disk>
Apr 14 13:12:34 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:12:34 user nova-compute[72019]:       <mac address="fa:16:3e:2d:13:e0"/>
Apr 14 13:12:34 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:12:34 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:12:34 user nova-compute[72019]:       <target dev="tap2255403b-5b"/>
Apr 14 13:12:34 user nova-compute[72019]:     </interface>
Apr 14 13:12:34 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:12:34 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/console.log" append="off"/>
Apr 14 13:12:34 user nova-compute[72019]:     </serial>
Apr 14 13:12:34 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:12:34 user nova-compute[72019]:     <video>
Apr 14 13:12:34 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:12:34 user nova-compute[72019]:     </video>
Apr 14 13:12:34 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:12:34 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:12:34 user nova-compute[72019]:     </rng>
Apr 14 13:12:34 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:12:34 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:12:34 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:12:34 user nova-compute[72019]:     </memballoon>
Apr 14 13:12:34 user nova-compute[72019]:   </devices>
Apr 14 13:12:34 user nova-compute[72019]: </domain>
Apr 14 13:12:34 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1108872439',display_name='tempest-DeleteServersTestJSON-server-1108872439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1108872439',id=1,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50d534e4c1cd4abb9204ce53e9a2a7b3',ramdisk_id='',reservation_id='r-7omwe66v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1521801319',owner_user_name='tempest-DeleteServersTestJSON-1521801319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:28Z,user_data=None,user_id='152f7a419a524915a216130426b32ea4',uuid=62e10eb2-a042-4916-8b61-51f7dcd731dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "address": "fa:16:3e:2d:13:e0", "network": {"id": "69762a08-01c9-4ee5-9118-3824b54739c4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721534193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d534e4c1cd4abb9204ce53e9a2a7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2255403b-5b", "ovs_interfaceid": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Converting VIF {"id": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "address": "fa:16:3e:2d:13:e0", "network": {"id": "69762a08-01c9-4ee5-9118-3824b54739c4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721534193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d534e4c1cd4abb9204ce53e9a2a7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2255403b-5b", "ovs_interfaceid": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:13:e0,bridge_name='br-int',has_traffic_filtering=True,id=2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74,network=Network(69762a08-01c9-4ee5-9118-3824b54739c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2255403b-5b') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG os_vif [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:13:e0,bridge_name='br-int',has_traffic_filtering=True,id=2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74,network=Network(69762a08-01c9-4ee5-9118-3824b54739c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2255403b-5b') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Created schema index Interface.name {{(pid=72019) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Created schema index Port.name {{(pid=72019) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Created schema index Bridge.name {{(pid=72019) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [POLLOUT] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.compute.manager [req-7eb06b15-250b-4681-9140-41f5c57240dd req-f55581c0-8d19-4cf7-917b-2e5d83660e8c service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-changed-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.compute.manager [req-7eb06b15-250b-4681-9140-41f5c57240dd req-f55581c0-8d19-4cf7-917b-2e5d83660e8c service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Refreshing instance network info cache due to event network-changed-e4b573e5-ec9a-4d14-974b-d8f2bf49c980. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7eb06b15-250b-4681-9140-41f5c57240dd req-f55581c0-8d19-4cf7-917b-2e5d83660e8c service nova] Acquiring lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7eb06b15-250b-4681-9140-41f5c57240dd req-f55581c0-8d19-4cf7-917b-2e5d83660e8c service nova] Acquired lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.network.neutron [req-7eb06b15-250b-4681-9140-41f5c57240dd req-f55581c0-8d19-4cf7-917b-2e5d83660e8c service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Refreshing network info cache for port e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:12:34 user nova-compute[72019]: INFO oslo.privsep.daemon [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpcualt4hb/privsep.sock']
Apr 14 13:12:34 user sudo[80972]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpcualt4hb/privsep.sock
Apr 14 13:12:34 user sudo[80972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 13:12:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:12:34 user nova-compute[72019]: INFO nova.compute.claims [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Claim successful on node user
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.network.neutron [req-7eb06b15-250b-4681-9140-41f5c57240dd req-f55581c0-8d19-4cf7-917b-2e5d83660e8c service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:12:34 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG nova.network.neutron [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:12:35 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:12:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:12:35 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Creating image(s)
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "/opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "/opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.149s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk 1073741824" returned: 0 in 0.046s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG nova.network.neutron [req-7eb06b15-250b-4681-9140-41f5c57240dd req-f55581c0-8d19-4cf7-917b-2e5d83660e8c service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7eb06b15-250b-4681-9140-41f5c57240dd req-f55581c0-8d19-4cf7-917b-2e5d83660e8c service nova] Releasing lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquired lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG nova.network.neutron [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Cannot resize image /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'migration_context' on Instance uuid cc4631eb-ae5b-4efa-9def-c0c45f56f40f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG nova.policy [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Ensure instance console log exists: /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:36 user nova-compute[72019]: DEBUG nova.network.neutron [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:12:36 user nova-compute[72019]: DEBUG nova.network.neutron [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Updated VIF entry in instance network info cache for port 2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:12:36 user nova-compute[72019]: DEBUG nova.network.neutron [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Updating instance_info_cache with network_info: [{"id": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "address": "fa:16:3e:2d:13:e0", "network": {"id": "69762a08-01c9-4ee5-9118-3824b54739c4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721534193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d534e4c1cd4abb9204ce53e9a2a7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2255403b-5b", "ovs_interfaceid": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:12:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] Releasing lock "refresh_cache-62e10eb2-a042-4916-8b61-51f7dcd731dd" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:12:36 user sudo[80972]: pam_unix(sudo:session): session closed for user root
Apr 14 13:12:36 user nova-compute[72019]: INFO oslo.privsep.daemon [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Spawned new privsep daemon via rootwrap
Apr 14 13:12:36 user nova-compute[72019]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 13:12:36 user nova-compute[72019]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 13:12:36 user nova-compute[72019]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 14 13:12:36 user nova-compute[72019]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80990
Apr 14 13:12:36 user nova-compute[72019]: DEBUG nova.network.neutron [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Successfully created port: f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2255403b-5b, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2255403b-5b, col_values=(('external_ids', {'iface-id': '2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:13:e0', 'vm-uuid': '62e10eb2-a042-4916-8b61-51f7dcd731dd'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:12:37 user nova-compute[72019]: INFO os_vif [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:13:e0,bridge_name='br-int',has_traffic_filtering=True,id=2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74,network=Network(69762a08-01c9-4ee5-9118-3824b54739c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2255403b-5b')
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.network.neutron [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Updating instance_info_cache with network_info: [{"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Releasing lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Instance network_info: |[{"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Start _get_guest_xml network_info=[{"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:12:37 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:12:37 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-303889780',display_name='tempest-AttachVolumeTestJSON-server-303889780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-303889780',id=2,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/dvc2S0OuXcn9jdXIUza2Um4pu7uvo7HYOG07F6fnb37QHZ7NdhG6QTqMXI3jbPISSO6VjhwOBRe6Loz+h6IedCzg/r0/inTPnR9XWKC/g2HpuZ9SyjRQ2J4QlDLD1WA==',key_name='tempest-keypair-641815070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a82aa8e6724a41e1a4e4d7783876536e',ramdisk_id='',reservation_id='r-s06nam6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-581564101',owner_user_name='tempest-AttachVolumeTestJSON-581564101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e4e432ab0d448db8c2437e40cbe0cd',uuid=84bf295a-37fa-4463-bddb-38ac2c5d2cf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converting VIF {"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'pci_devices' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] No VIF found with MAC fa:16:3e:2d:13:e0, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:12:37 user nova-compute[72019]:   <uuid>84bf295a-37fa-4463-bddb-38ac2c5d2cf7</uuid>
Apr 14 13:12:37 user nova-compute[72019]:   <name>instance-00000002</name>
Apr 14 13:12:37 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:12:37 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:12:37 user nova-compute[72019]:   <metadata>
Apr 14 13:12:37 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:12:37 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:12:37 user nova-compute[72019]:       <nova:name>tempest-AttachVolumeTestJSON-server-303889780</nova:name>
Apr 14 13:12:37 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:12:37</nova:creationTime>
Apr 14 13:12:37 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:12:37 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:12:37 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:12:37 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:12:37 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:12:37 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:12:37 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:12:37 user nova-compute[72019]:       <nova:owner>
Apr 14 13:12:37 user nova-compute[72019]:         <nova:user uuid="d7e4e432ab0d448db8c2437e40cbe0cd">tempest-AttachVolumeTestJSON-581564101-project-member</nova:user>
Apr 14 13:12:37 user nova-compute[72019]:         <nova:project uuid="a82aa8e6724a41e1a4e4d7783876536e">tempest-AttachVolumeTestJSON-581564101</nova:project>
Apr 14 13:12:37 user nova-compute[72019]:       </nova:owner>
Apr 14 13:12:37 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:12:37 user nova-compute[72019]:       <nova:ports>
Apr 14 13:12:37 user nova-compute[72019]:         <nova:port uuid="e4b573e5-ec9a-4d14-974b-d8f2bf49c980">
Apr 14 13:12:37 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 13:12:37 user nova-compute[72019]:         </nova:port>
Apr 14 13:12:37 user nova-compute[72019]:       </nova:ports>
Apr 14 13:12:37 user nova-compute[72019]:     </nova:instance>
Apr 14 13:12:37 user nova-compute[72019]:   </metadata>
Apr 14 13:12:37 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:12:37 user nova-compute[72019]:     <system>
Apr 14 13:12:37 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:12:37 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:12:37 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:12:37 user nova-compute[72019]:       <entry name="serial">84bf295a-37fa-4463-bddb-38ac2c5d2cf7</entry>
Apr 14 13:12:37 user nova-compute[72019]:       <entry name="uuid">84bf295a-37fa-4463-bddb-38ac2c5d2cf7</entry>
Apr 14 13:12:37 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:12:37 user nova-compute[72019]:     </system>
Apr 14 13:12:37 user nova-compute[72019]:   </sysinfo>
Apr 14 13:12:37 user nova-compute[72019]:   <os>
Apr 14 13:12:37 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:12:37 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:12:37 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:12:37 user nova-compute[72019]:   </os>
Apr 14 13:12:37 user nova-compute[72019]:   <features>
Apr 14 13:12:37 user nova-compute[72019]:     <acpi/>
Apr 14 13:12:37 user nova-compute[72019]:     <apic/>
Apr 14 13:12:37 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:12:37 user nova-compute[72019]:   </features>
Apr 14 13:12:37 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:12:37 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:12:37 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:12:37 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:12:37 user nova-compute[72019]:   </clock>
Apr 14 13:12:37 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:12:37 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:12:37 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:12:37 user nova-compute[72019]:   </cpu>
Apr 14 13:12:37 user nova-compute[72019]:   <devices>
Apr 14 13:12:37 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:12:37 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:12:37 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk"/>
Apr 14 13:12:37 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:12:37 user nova-compute[72019]:     </disk>
Apr 14 13:12:37 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:12:37 user nova-compute[72019]:       <mac address="fa:16:3e:23:7a:d0"/>
Apr 14 13:12:37 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:12:37 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:12:37 user nova-compute[72019]:       <target dev="tape4b573e5-ec"/>
Apr 14 13:12:37 user nova-compute[72019]:     </interface>
Apr 14 13:12:37 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:12:37 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/console.log" append="off"/>
Apr 14 13:12:37 user nova-compute[72019]:     </serial>
Apr 14 13:12:37 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:12:37 user nova-compute[72019]:     <video>
Apr 14 13:12:37 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:12:37 user nova-compute[72019]:     </video>
Apr 14 13:12:37 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:12:37 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:12:37 user nova-compute[72019]:     </rng>
Apr 14 13:12:37 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:12:37 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:12:37 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:12:37 user nova-compute[72019]:     </memballoon>
Apr 14 13:12:37 user nova-compute[72019]:   </devices>
Apr 14 13:12:37 user nova-compute[72019]: </domain>
Apr 14 13:12:37 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-303889780',display_name='tempest-AttachVolumeTestJSON-server-303889780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-303889780',id=2,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/dvc2S0OuXcn9jdXIUza2Um4pu7uvo7HYOG07F6fnb37QHZ7NdhG6QTqMXI3jbPISSO6VjhwOBRe6Loz+h6IedCzg/r0/inTPnR9XWKC/g2HpuZ9SyjRQ2J4QlDLD1WA==',key_name='tempest-keypair-641815070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a82aa8e6724a41e1a4e4d7783876536e',ramdisk_id='',reservation_id='r-s06nam6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-581564101',owner_user_name='tempest-AttachVolumeTestJSON-581564101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e4e432ab0d448db8c2437e40cbe0cd',uuid=84bf295a-37fa-4463-bddb-38ac2c5d2cf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converting VIF {"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG os_vif [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4b573e5-ec, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4b573e5-ec, col_values=(('external_ids', {'iface-id': 'e4b573e5-ec9a-4d14-974b-d8f2bf49c980', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:7a:d0', 'vm-uuid': '84bf295a-37fa-4463-bddb-38ac2c5d2cf7'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:37 user nova-compute[72019]: INFO os_vif [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec')
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] No VIF found with MAC fa:16:3e:23:7a:d0, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:12:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:39 user nova-compute[72019]: DEBUG nova.network.neutron [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Successfully created port: d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:12:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:12:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:12:39 user nova-compute[72019]: INFO nova.compute.claims [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Claim successful on node user
Apr 14 13:12:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:39 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:12:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:39 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG nova.compute.manager [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG nova.compute.manager [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG nova.network.neutron [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:12:40 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:12:40 user nova-compute[72019]: DEBUG nova.compute.manager [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG nova.compute.manager [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:12:40 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Creating image(s)
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "/opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "/opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "/opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG nova.policy [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.148s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.157s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk 1073741824" returned: 0 in 0.045s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:12:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Cannot resize image /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG nova.objects.instance [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'migration_context' on Instance uuid c34d24a3-a632-4f05-b6fb-dc3562dc93d6 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Ensure instance console log exists: /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG nova.network.neutron [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Successfully updated port: f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquired lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG nova.network.neutron [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-b3155f0e-8fe9-4e6d-a737-660f3d8beba2 req-dec9e573-f57e-42f7-a58d-bdee828343e1 service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Received event network-vif-plugged-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b3155f0e-8fe9-4e6d-a737-660f3d8beba2 req-dec9e573-f57e-42f7-a58d-bdee828343e1 service nova] Acquiring lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b3155f0e-8fe9-4e6d-a737-660f3d8beba2 req-dec9e573-f57e-42f7-a58d-bdee828343e1 service nova] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b3155f0e-8fe9-4e6d-a737-660f3d8beba2 req-dec9e573-f57e-42f7-a58d-bdee828343e1 service nova] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-b3155f0e-8fe9-4e6d-a737-660f3d8beba2 req-dec9e573-f57e-42f7-a58d-bdee828343e1 service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] No waiting events found dispatching network-vif-plugged-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:12:41 user nova-compute[72019]: WARNING nova.compute.manager [req-b3155f0e-8fe9-4e6d-a737-660f3d8beba2 req-dec9e573-f57e-42f7-a58d-bdee828343e1 service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Received unexpected event network-vif-plugged-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 for instance with vm_state building and task_state spawning.
Apr 14 13:12:41 user nova-compute[72019]: DEBUG nova.network.neutron [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477962.1204197, 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:12:42 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] VM Resumed (Lifecycle Event)
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:12:42 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Instance spawned successfully.
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:12:42 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477962.1413772, 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:12:42 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] VM Started (Lifecycle Event)
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:12:42 user nova-compute[72019]: INFO nova.compute.manager [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Took 13.55 seconds to spawn the instance on the hypervisor.
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.compute.manager [req-a8a65257-a61e-46a8-84fd-012c0e5ce569 req-1fb566bb-fb86-43fd-b7ef-a01c2f913ef9 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a8a65257-a61e-46a8-84fd-012c0e5ce569 req-1fb566bb-fb86-43fd-b7ef-a01c2f913ef9 service nova] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a8a65257-a61e-46a8-84fd-012c0e5ce569 req-1fb566bb-fb86-43fd-b7ef-a01c2f913ef9 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a8a65257-a61e-46a8-84fd-012c0e5ce569 req-1fb566bb-fb86-43fd-b7ef-a01c2f913ef9 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.compute.manager [req-a8a65257-a61e-46a8-84fd-012c0e5ce569 req-1fb566bb-fb86-43fd-b7ef-a01c2f913ef9 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] No waiting events found dispatching network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:12:42 user nova-compute[72019]: WARNING nova.compute.manager [req-a8a65257-a61e-46a8-84fd-012c0e5ce569 req-1fb566bb-fb86-43fd-b7ef-a01c2f913ef9 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received unexpected event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance with vm_state building and task_state spawning.
Apr 14 13:12:42 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477962.4123266, 62e10eb2-a042-4916-8b61-51f7dcd731dd => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:12:42 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] VM Resumed (Lifecycle Event)
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:42 user nova-compute[72019]: INFO nova.compute.manager [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Took 14.48 seconds to build instance.
Apr 14 13:12:42 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Instance spawned successfully.
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:42 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477962.4147465, 62e10eb2-a042-4916-8b61-51f7dcd731dd => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:12:42 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] VM Started (Lifecycle Event)
Apr 14 13:12:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.632s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:12:42 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:12:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:42 user nova-compute[72019]: INFO nova.compute.manager [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Took 14.34 seconds to spawn the instance on the hypervisor.
Apr 14 13:12:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:42 user nova-compute[72019]: INFO nova.compute.manager [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Took 15.43 seconds to build instance.
Apr 14 13:12:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.639s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.network.neutron [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Successfully created port: 5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.network.neutron [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Updating instance_info_cache with network_info: [{"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Releasing lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Instance network_info: |[{"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Start _get_guest_xml network_info=[{"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:12:43 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:12:43 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-299687148',display_name='tempest-ServerRescueNegativeTestJSON-server-299687148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-299687148',id=3,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7c8c8f620334166a141ea65525ba2a0',ramdisk_id='',reservation_id='r-876svson',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1698214771',owner_user_name='tempest-ServerRescueNegativeTestJSON-1698214771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:32Z,user_data=None,user_id='3948b7c643374bcdbeb34f0f2f790c3c',uuid=29dc5faa-e15a-425c-80f8-ddb4f34f43d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converting VIF {"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:26:54,bridge_name='br-int',has_traffic_filtering=True,id=f15f52ef-e473-4957-8be2-8c3ef6a9aa16,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15f52ef-e4') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'pci_devices' on Instance uuid 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:12:43 user nova-compute[72019]:   <uuid>29dc5faa-e15a-425c-80f8-ddb4f34f43d4</uuid>
Apr 14 13:12:43 user nova-compute[72019]:   <name>instance-00000003</name>
Apr 14 13:12:43 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:12:43 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:12:43 user nova-compute[72019]:   <metadata>
Apr 14 13:12:43 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:12:43 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:12:43 user nova-compute[72019]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-299687148</nova:name>
Apr 14 13:12:43 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:12:43</nova:creationTime>
Apr 14 13:12:43 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:12:43 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:12:43 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:12:43 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:12:43 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:12:43 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:12:43 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:12:43 user nova-compute[72019]:       <nova:owner>
Apr 14 13:12:43 user nova-compute[72019]:         <nova:user uuid="3948b7c643374bcdbeb34f0f2f790c3c">tempest-ServerRescueNegativeTestJSON-1698214771-project-member</nova:user>
Apr 14 13:12:43 user nova-compute[72019]:         <nova:project uuid="a7c8c8f620334166a141ea65525ba2a0">tempest-ServerRescueNegativeTestJSON-1698214771</nova:project>
Apr 14 13:12:43 user nova-compute[72019]:       </nova:owner>
Apr 14 13:12:43 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:12:43 user nova-compute[72019]:       <nova:ports>
Apr 14 13:12:43 user nova-compute[72019]:         <nova:port uuid="f15f52ef-e473-4957-8be2-8c3ef6a9aa16">
Apr 14 13:12:43 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 13:12:43 user nova-compute[72019]:         </nova:port>
Apr 14 13:12:43 user nova-compute[72019]:       </nova:ports>
Apr 14 13:12:43 user nova-compute[72019]:     </nova:instance>
Apr 14 13:12:43 user nova-compute[72019]:   </metadata>
Apr 14 13:12:43 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:12:43 user nova-compute[72019]:     <system>
Apr 14 13:12:43 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:12:43 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:12:43 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:12:43 user nova-compute[72019]:       <entry name="serial">29dc5faa-e15a-425c-80f8-ddb4f34f43d4</entry>
Apr 14 13:12:43 user nova-compute[72019]:       <entry name="uuid">29dc5faa-e15a-425c-80f8-ddb4f34f43d4</entry>
Apr 14 13:12:43 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:12:43 user nova-compute[72019]:     </system>
Apr 14 13:12:43 user nova-compute[72019]:   </sysinfo>
Apr 14 13:12:43 user nova-compute[72019]:   <os>
Apr 14 13:12:43 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:12:43 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:12:43 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:12:43 user nova-compute[72019]:   </os>
Apr 14 13:12:43 user nova-compute[72019]:   <features>
Apr 14 13:12:43 user nova-compute[72019]:     <acpi/>
Apr 14 13:12:43 user nova-compute[72019]:     <apic/>
Apr 14 13:12:43 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:12:43 user nova-compute[72019]:   </features>
Apr 14 13:12:43 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:12:43 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:12:43 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:12:43 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:12:43 user nova-compute[72019]:   </clock>
Apr 14 13:12:43 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:12:43 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:12:43 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:12:43 user nova-compute[72019]:   </cpu>
Apr 14 13:12:43 user nova-compute[72019]:   <devices>
Apr 14 13:12:43 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:12:43 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:12:43 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk"/>
Apr 14 13:12:43 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:12:43 user nova-compute[72019]:     </disk>
Apr 14 13:12:43 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:12:43 user nova-compute[72019]:       <mac address="fa:16:3e:4e:26:54"/>
Apr 14 13:12:43 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:12:43 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:12:43 user nova-compute[72019]:       <target dev="tapf15f52ef-e4"/>
Apr 14 13:12:43 user nova-compute[72019]:     </interface>
Apr 14 13:12:43 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:12:43 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/console.log" append="off"/>
Apr 14 13:12:43 user nova-compute[72019]:     </serial>
Apr 14 13:12:43 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:12:43 user nova-compute[72019]:     <video>
Apr 14 13:12:43 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:12:43 user nova-compute[72019]:     </video>
Apr 14 13:12:43 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:12:43 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:12:43 user nova-compute[72019]:     </rng>
Apr 14 13:12:43 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:12:43 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:12:43 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:12:43 user nova-compute[72019]:     </memballoon>
Apr 14 13:12:43 user nova-compute[72019]:   </devices>
Apr 14 13:12:43 user nova-compute[72019]: </domain>
Apr 14 13:12:43 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-299687148',display_name='tempest-ServerRescueNegativeTestJSON-server-299687148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-299687148',id=3,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7c8c8f620334166a141ea65525ba2a0',ramdisk_id='',reservation_id='r-876svson',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1698214771',owner_user_name='tempest-ServerRescueNegativeTestJSON-1698214771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:32Z,user_data=None,user_id='3948b7c643374bcdbeb34f0f2f790c3c',uuid=29dc5faa-e15a-425c-80f8-ddb4f34f43d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converting VIF {"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:26:54,bridge_name='br-int',has_traffic_filtering=True,id=f15f52ef-e473-4957-8be2-8c3ef6a9aa16,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15f52ef-e4') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG os_vif [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:26:54,bridge_name='br-int',has_traffic_filtering=True,id=f15f52ef-e473-4957-8be2-8c3ef6a9aa16,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15f52ef-e4') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf15f52ef-e4, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf15f52ef-e4, col_values=(('external_ids', {'iface-id': 'f15f52ef-e473-4957-8be2-8c3ef6a9aa16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:26:54', 'vm-uuid': '29dc5faa-e15a-425c-80f8-ddb4f34f43d4'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:43 user nova-compute[72019]: INFO os_vif [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:26:54,bridge_name='br-int',has_traffic_filtering=True,id=f15f52ef-e473-4957-8be2-8c3ef6a9aa16,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15f52ef-e4')
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No VIF found with MAC fa:16:3e:4e:26:54, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-changed-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Refreshing instance network info cache due to event network-changed-f15f52ef-e473-4957-8be2-8c3ef6a9aa16. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] Acquiring lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] Acquired lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.network.neutron [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Refreshing network info cache for port f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.network.neutron [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Successfully updated port: d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquired lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:12:43 user nova-compute[72019]: DEBUG nova.network.neutron [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:12:44 user nova-compute[72019]: DEBUG nova.network.neutron [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:12:44 user nova-compute[72019]: DEBUG nova.compute.manager [req-98b371f9-7b42-4381-ad66-708e47658724 req-39d999e9-3050-4669-8af4-bf01f817044f service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-98b371f9-7b42-4381-ad66-708e47658724 req-39d999e9-3050-4669-8af4-bf01f817044f service nova] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-98b371f9-7b42-4381-ad66-708e47658724 req-39d999e9-3050-4669-8af4-bf01f817044f service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-98b371f9-7b42-4381-ad66-708e47658724 req-39d999e9-3050-4669-8af4-bf01f817044f service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:44 user nova-compute[72019]: DEBUG nova.compute.manager [req-98b371f9-7b42-4381-ad66-708e47658724 req-39d999e9-3050-4669-8af4-bf01f817044f service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] No waiting events found dispatching network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:12:44 user nova-compute[72019]: WARNING nova.compute.manager [req-98b371f9-7b42-4381-ad66-708e47658724 req-39d999e9-3050-4669-8af4-bf01f817044f service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received unexpected event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance with vm_state active and task_state None.
Apr 14 13:12:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.compute.manager [req-37e69add-e1f5-4855-8c4c-6f5e28002621 req-a6f2188a-a5c2-4f13-b4c3-89748f54d196 service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received event network-changed-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.compute.manager [req-37e69add-e1f5-4855-8c4c-6f5e28002621 req-a6f2188a-a5c2-4f13-b4c3-89748f54d196 service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Refreshing instance network info cache due to event network-changed-d5720602-747e-4fff-8334-2412fa184f73. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-37e69add-e1f5-4855-8c4c-6f5e28002621 req-a6f2188a-a5c2-4f13-b4c3-89748f54d196 service nova] Acquiring lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.network.neutron [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Successfully updated port: 5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "refresh_cache-c34d24a3-a632-4f05-b6fb-dc3562dc93d6" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquired lock "refresh_cache-c34d24a3-a632-4f05-b6fb-dc3562dc93d6" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.network.neutron [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.network.neutron [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Updating instance_info_cache with network_info: [{"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.compute.manager [req-feb9769c-335d-4373-8ac4-961f6bd537f1 req-1322a4cc-dc08-403d-a5da-25c9baddaa67 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-feb9769c-335d-4373-8ac4-961f6bd537f1 req-1322a4cc-dc08-403d-a5da-25c9baddaa67 service nova] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-feb9769c-335d-4373-8ac4-961f6bd537f1 req-1322a4cc-dc08-403d-a5da-25c9baddaa67 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-feb9769c-335d-4373-8ac4-961f6bd537f1 req-1322a4cc-dc08-403d-a5da-25c9baddaa67 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.compute.manager [req-feb9769c-335d-4373-8ac4-961f6bd537f1 req-1322a4cc-dc08-403d-a5da-25c9baddaa67 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] No waiting events found dispatching network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:12:46 user nova-compute[72019]: WARNING nova.compute.manager [req-feb9769c-335d-4373-8ac4-961f6bd537f1 req-1322a4cc-dc08-403d-a5da-25c9baddaa67 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received unexpected event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance with vm_state building and task_state spawning.
Apr 14 13:12:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Releasing lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Instance network_info: |[{"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-37e69add-e1f5-4855-8c4c-6f5e28002621 req-a6f2188a-a5c2-4f13-b4c3-89748f54d196 service nova] Acquired lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.network.neutron [req-37e69add-e1f5-4855-8c4c-6f5e28002621 req-a6f2188a-a5c2-4f13-b4c3-89748f54d196 service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Refreshing network info cache for port d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Start _get_guest_xml network_info=[{"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:12:46 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:12:46 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1383992809',display_name='tempest-ServerRescueNegativeTestJSON-server-1383992809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1383992809',id=4,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7c8c8f620334166a141ea65525ba2a0',ramdisk_id='',reservation_id='r-7zkpx5xm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1698214771',owner_user_name='tempest-ServerRescueNegativeTestJSON-1698214771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:35Z,user_data=None,user_id='3948b7c643374bcdbeb34f0f2f790c3c',uuid=cc4631eb-ae5b-4efa-9def-c0c45f56f40f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converting VIF {"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cc:9c,bridge_name='br-int',has_traffic_filtering=True,id=d5720602-747e-4fff-8334-2412fa184f73,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5720602-74') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'pci_devices' on Instance uuid cc4631eb-ae5b-4efa-9def-c0c45f56f40f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.network.neutron [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Updated VIF entry in instance network info cache for port f15f52ef-e473-4957-8be2-8c3ef6a9aa16. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.network.neutron [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Updating instance_info_cache with network_info: [{"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:12:46 user nova-compute[72019]:   <uuid>cc4631eb-ae5b-4efa-9def-c0c45f56f40f</uuid>
Apr 14 13:12:46 user nova-compute[72019]:   <name>instance-00000004</name>
Apr 14 13:12:46 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:12:46 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:12:46 user nova-compute[72019]:   <metadata>
Apr 14 13:12:46 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:12:46 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:12:46 user nova-compute[72019]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1383992809</nova:name>
Apr 14 13:12:46 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:12:46</nova:creationTime>
Apr 14 13:12:46 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:12:46 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:12:46 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:12:46 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:12:46 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:12:46 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:12:46 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:12:46 user nova-compute[72019]:       <nova:owner>
Apr 14 13:12:46 user nova-compute[72019]:         <nova:user uuid="3948b7c643374bcdbeb34f0f2f790c3c">tempest-ServerRescueNegativeTestJSON-1698214771-project-member</nova:user>
Apr 14 13:12:46 user nova-compute[72019]:         <nova:project uuid="a7c8c8f620334166a141ea65525ba2a0">tempest-ServerRescueNegativeTestJSON-1698214771</nova:project>
Apr 14 13:12:46 user nova-compute[72019]:       </nova:owner>
Apr 14 13:12:46 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:12:46 user nova-compute[72019]:       <nova:ports>
Apr 14 13:12:46 user nova-compute[72019]:         <nova:port uuid="d5720602-747e-4fff-8334-2412fa184f73">
Apr 14 13:12:46 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 13:12:46 user nova-compute[72019]:         </nova:port>
Apr 14 13:12:46 user nova-compute[72019]:       </nova:ports>
Apr 14 13:12:46 user nova-compute[72019]:     </nova:instance>
Apr 14 13:12:46 user nova-compute[72019]:   </metadata>
Apr 14 13:12:46 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:12:46 user nova-compute[72019]:     <system>
Apr 14 13:12:46 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:12:46 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:12:46 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:12:46 user nova-compute[72019]:       <entry name="serial">cc4631eb-ae5b-4efa-9def-c0c45f56f40f</entry>
Apr 14 13:12:46 user nova-compute[72019]:       <entry name="uuid">cc4631eb-ae5b-4efa-9def-c0c45f56f40f</entry>
Apr 14 13:12:46 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:12:46 user nova-compute[72019]:     </system>
Apr 14 13:12:46 user nova-compute[72019]:   </sysinfo>
Apr 14 13:12:46 user nova-compute[72019]:   <os>
Apr 14 13:12:46 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:12:46 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:12:46 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:12:46 user nova-compute[72019]:   </os>
Apr 14 13:12:46 user nova-compute[72019]:   <features>
Apr 14 13:12:46 user nova-compute[72019]:     <acpi/>
Apr 14 13:12:46 user nova-compute[72019]:     <apic/>
Apr 14 13:12:46 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:12:46 user nova-compute[72019]:   </features>
Apr 14 13:12:46 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:12:46 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:12:46 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:12:46 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:12:46 user nova-compute[72019]:   </clock>
Apr 14 13:12:46 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:12:46 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:12:46 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:12:46 user nova-compute[72019]:   </cpu>
Apr 14 13:12:46 user nova-compute[72019]:   <devices>
Apr 14 13:12:46 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:12:46 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:12:46 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk"/>
Apr 14 13:12:46 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:12:46 user nova-compute[72019]:     </disk>
Apr 14 13:12:46 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:12:46 user nova-compute[72019]:       <mac address="fa:16:3e:d4:cc:9c"/>
Apr 14 13:12:46 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:12:46 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:12:46 user nova-compute[72019]:       <target dev="tapd5720602-74"/>
Apr 14 13:12:46 user nova-compute[72019]:     </interface>
Apr 14 13:12:46 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:12:46 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/console.log" append="off"/>
Apr 14 13:12:46 user nova-compute[72019]:     </serial>
Apr 14 13:12:46 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:12:46 user nova-compute[72019]:     <video>
Apr 14 13:12:46 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:12:46 user nova-compute[72019]:     </video>
Apr 14 13:12:46 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:12:46 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:12:46 user nova-compute[72019]:     </rng>
Apr 14 13:12:46 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:12:46 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:12:46 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:12:46 user nova-compute[72019]:     </memballoon>
Apr 14 13:12:46 user nova-compute[72019]:   </devices>
Apr 14 13:12:46 user nova-compute[72019]: </domain>
Apr 14 13:12:46 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1383992809',display_name='tempest-ServerRescueNegativeTestJSON-server-1383992809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1383992809',id=4,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7c8c8f620334166a141ea65525ba2a0',ramdisk_id='',reservation_id='r-7zkpx5xm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1698214771',owner_user_name='tempest-ServerRescueNegativeTestJSON-1698214771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:35Z,user_data=None,user_id='3948b7c643374bcdbeb34f0f2f790c3c',uuid=cc4631eb-ae5b-4efa-9def-c0c45f56f40f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converting VIF {"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cc:9c,bridge_name='br-int',has_traffic_filtering=True,id=d5720602-747e-4fff-8334-2412fa184f73,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5720602-74') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG os_vif [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cc:9c,bridge_name='br-int',has_traffic_filtering=True,id=d5720602-747e-4fff-8334-2412fa184f73,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5720602-74') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] Releasing lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.compute.manager [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Received event network-vif-plugged-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] Acquiring lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.compute.manager [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] No waiting events found dispatching network-vif-plugged-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:12:46 user nova-compute[72019]: WARNING nova.compute.manager [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Received unexpected event network-vif-plugged-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 for instance with vm_state active and task_state None.
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.network.neutron [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5720602-74, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5720602-74, col_values=(('external_ids', {'iface-id': 'd5720602-747e-4fff-8334-2412fa184f73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:cc:9c', 'vm-uuid': 'cc4631eb-ae5b-4efa-9def-c0c45f56f40f'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:46 user nova-compute[72019]: INFO os_vif [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cc:9c,bridge_name='br-int',has_traffic_filtering=True,id=d5720602-747e-4fff-8334-2412fa184f73,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5720602-74')
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:12:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No VIF found with MAC fa:16:3e:d4:cc:9c, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Updating instance_info_cache with network_info: [{"id": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "address": "fa:16:3e:52:d9:41", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab05b1-9e", "ovs_interfaceid": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Releasing lock "refresh_cache-c34d24a3-a632-4f05-b6fb-dc3562dc93d6" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Instance network_info: |[{"id": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "address": "fa:16:3e:52:d9:41", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab05b1-9e", "ovs_interfaceid": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Start _get_guest_xml network_info=[{"id": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "address": "fa:16:3e:52:d9:41", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab05b1-9e", "ovs_interfaceid": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:12:47 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:12:47 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1885721133',display_name='tempest-AttachVolumeNegativeTest-server-1885721133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1885721133',id=5,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvwjWdhdL4p/vot8ehhliLkgSS+VX3N3hpUfRnGb4cxQCzMi+uh/nKjV34jvCMuz1AcDAnUhheia6vRHCdkI6iN4byvGQyKLEzU6N7m6Pa1bYwwTvypkLGfgAQNH5PIpA==',key_name='tempest-keypair-359510273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6833a69217034c4d85ff10bf8aa2fa5c',ramdisk_id='',reservation_id='r-vt0mzk0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-893959880',owner_user_name='tempest-AttachVolumeNegativeTest-893959880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65812c6559684eddbdde33cd64ca1fba',uuid=c34d24a3-a632-4f05-b6fb-dc3562dc93d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "address": "fa:16:3e:52:d9:41", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab05b1-9e", "ovs_interfaceid": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converting VIF {"id": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "address": "fa:16:3e:52:d9:41", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab05b1-9e", "ovs_interfaceid": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:d9:41,bridge_name='br-int',has_traffic_filtering=True,id=5fab05b1-9e56-4f0d-84e0-22573efdb2c4,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fab05b1-9e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.objects.instance [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'pci_devices' on Instance uuid c34d24a3-a632-4f05-b6fb-dc3562dc93d6 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:12:47 user nova-compute[72019]:   <uuid>c34d24a3-a632-4f05-b6fb-dc3562dc93d6</uuid>
Apr 14 13:12:47 user nova-compute[72019]:   <name>instance-00000005</name>
Apr 14 13:12:47 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:12:47 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:12:47 user nova-compute[72019]:   <metadata>
Apr 14 13:12:47 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:12:47 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:12:47 user nova-compute[72019]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1885721133</nova:name>
Apr 14 13:12:47 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:12:47</nova:creationTime>
Apr 14 13:12:47 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:12:47 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:12:47 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:12:47 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:12:47 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:12:47 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:12:47 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:12:47 user nova-compute[72019]:       <nova:owner>
Apr 14 13:12:47 user nova-compute[72019]:         <nova:user uuid="65812c6559684eddbdde33cd64ca1fba">tempest-AttachVolumeNegativeTest-893959880-project-member</nova:user>
Apr 14 13:12:47 user nova-compute[72019]:         <nova:project uuid="6833a69217034c4d85ff10bf8aa2fa5c">tempest-AttachVolumeNegativeTest-893959880</nova:project>
Apr 14 13:12:47 user nova-compute[72019]:       </nova:owner>
Apr 14 13:12:47 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:12:47 user nova-compute[72019]:       <nova:ports>
Apr 14 13:12:47 user nova-compute[72019]:         <nova:port uuid="5fab05b1-9e56-4f0d-84e0-22573efdb2c4">
Apr 14 13:12:47 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 13:12:47 user nova-compute[72019]:         </nova:port>
Apr 14 13:12:47 user nova-compute[72019]:       </nova:ports>
Apr 14 13:12:47 user nova-compute[72019]:     </nova:instance>
Apr 14 13:12:47 user nova-compute[72019]:   </metadata>
Apr 14 13:12:47 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:12:47 user nova-compute[72019]:     <system>
Apr 14 13:12:47 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:12:47 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:12:47 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:12:47 user nova-compute[72019]:       <entry name="serial">c34d24a3-a632-4f05-b6fb-dc3562dc93d6</entry>
Apr 14 13:12:47 user nova-compute[72019]:       <entry name="uuid">c34d24a3-a632-4f05-b6fb-dc3562dc93d6</entry>
Apr 14 13:12:47 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:12:47 user nova-compute[72019]:     </system>
Apr 14 13:12:47 user nova-compute[72019]:   </sysinfo>
Apr 14 13:12:47 user nova-compute[72019]:   <os>
Apr 14 13:12:47 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:12:47 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:12:47 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:12:47 user nova-compute[72019]:   </os>
Apr 14 13:12:47 user nova-compute[72019]:   <features>
Apr 14 13:12:47 user nova-compute[72019]:     <acpi/>
Apr 14 13:12:47 user nova-compute[72019]:     <apic/>
Apr 14 13:12:47 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:12:47 user nova-compute[72019]:   </features>
Apr 14 13:12:47 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:12:47 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:12:47 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:12:47 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:12:47 user nova-compute[72019]:   </clock>
Apr 14 13:12:47 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:12:47 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:12:47 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:12:47 user nova-compute[72019]:   </cpu>
Apr 14 13:12:47 user nova-compute[72019]:   <devices>
Apr 14 13:12:47 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:12:47 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:12:47 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk"/>
Apr 14 13:12:47 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:12:47 user nova-compute[72019]:     </disk>
Apr 14 13:12:47 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:12:47 user nova-compute[72019]:       <mac address="fa:16:3e:52:d9:41"/>
Apr 14 13:12:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:12:47 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:12:47 user nova-compute[72019]:       <target dev="tap5fab05b1-9e"/>
Apr 14 13:12:47 user nova-compute[72019]:     </interface>
Apr 14 13:12:47 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:12:47 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/console.log" append="off"/>
Apr 14 13:12:47 user nova-compute[72019]:     </serial>
Apr 14 13:12:47 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:12:47 user nova-compute[72019]:     <video>
Apr 14 13:12:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:12:47 user nova-compute[72019]:     </video>
Apr 14 13:12:47 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:12:47 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:12:47 user nova-compute[72019]:     </rng>
Apr 14 13:12:47 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:12:47 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:12:47 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:12:47 user nova-compute[72019]:     </memballoon>
Apr 14 13:12:47 user nova-compute[72019]:   </devices>
Apr 14 13:12:47 user nova-compute[72019]: </domain>
Apr 14 13:12:47 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1885721133',display_name='tempest-AttachVolumeNegativeTest-server-1885721133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1885721133',id=5,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvwjWdhdL4p/vot8ehhliLkgSS+VX3N3hpUfRnGb4cxQCzMi+uh/nKjV34jvCMuz1AcDAnUhheia6vRHCdkI6iN4byvGQyKLEzU6N7m6Pa1bYwwTvypkLGfgAQNH5PIpA==',key_name='tempest-keypair-359510273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6833a69217034c4d85ff10bf8aa2fa5c',ramdisk_id='',reservation_id='r-vt0mzk0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-893959880',owner_user_name='tempest-AttachVolumeNegativeTest-893959880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65812c6559684eddbdde33cd64ca1fba',uuid=c34d24a3-a632-4f05-b6fb-dc3562dc93d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "address": "fa:16:3e:52:d9:41", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab05b1-9e", "ovs_interfaceid": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converting VIF {"id": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "address": "fa:16:3e:52:d9:41", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab05b1-9e", "ovs_interfaceid": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:d9:41,bridge_name='br-int',has_traffic_filtering=True,id=5fab05b1-9e56-4f0d-84e0-22573efdb2c4,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fab05b1-9e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG os_vif [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:d9:41,bridge_name='br-int',has_traffic_filtering=True,id=5fab05b1-9e56-4f0d-84e0-22573efdb2c4,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fab05b1-9e') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fab05b1-9e, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5fab05b1-9e, col_values=(('external_ids', {'iface-id': '5fab05b1-9e56-4f0d-84e0-22573efdb2c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:d9:41', 'vm-uuid': 'c34d24a3-a632-4f05-b6fb-dc3562dc93d6'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:47 user nova-compute[72019]: INFO os_vif [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:d9:41,bridge_name='br-int',has_traffic_filtering=True,id=5fab05b1-9e56-4f0d-84e0-22573efdb2c4,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fab05b1-9e')
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:12:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No VIF found with MAC fa:16:3e:52:d9:41, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-37e69add-e1f5-4855-8c4c-6f5e28002621 req-a6f2188a-a5c2-4f13-b4c3-89748f54d196 service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Updated VIF entry in instance network info cache for port d5720602-747e-4fff-8334-2412fa184f73. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-37e69add-e1f5-4855-8c4c-6f5e28002621 req-a6f2188a-a5c2-4f13-b4c3-89748f54d196 service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Updating instance_info_cache with network_info: [{"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-37e69add-e1f5-4855-8c4c-6f5e28002621 req-a6f2188a-a5c2-4f13-b4c3-89748f54d196 service nova] Releasing lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477968.385013, 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:12:48 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] VM Resumed (Lifecycle Event)
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:12:48 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Instance spawned successfully.
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:48 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477968.3867917, 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:12:48 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] VM Started (Lifecycle Event)
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.compute.manager [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Received event network-changed-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.compute.manager [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Refreshing instance network info cache due to event network-changed-5fab05b1-9e56-4f0d-84e0-22573efdb2c4. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] Acquiring lock "refresh_cache-c34d24a3-a632-4f05-b6fb-dc3562dc93d6" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] Acquired lock "refresh_cache-c34d24a3-a632-4f05-b6fb-dc3562dc93d6" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Refreshing network info cache for port 5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:12:48 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:12:48 user nova-compute[72019]: INFO nova.compute.manager [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Took 16.28 seconds to spawn the instance on the hypervisor.
Apr 14 13:12:48 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:48 user nova-compute[72019]: INFO nova.compute.manager [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Took 16.94 seconds to build instance.
Apr 14 13:12:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.060s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG nova.network.neutron [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Updated VIF entry in instance network info cache for port 5fab05b1-9e56-4f0d-84e0-22573efdb2c4. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG nova.network.neutron [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Updating instance_info_cache with network_info: [{"id": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "address": "fa:16:3e:52:d9:41", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab05b1-9e", "ovs_interfaceid": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] Releasing lock "refresh_cache-c34d24a3-a632-4f05-b6fb-dc3562dc93d6" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] No waiting events found dispatching network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:12:50 user nova-compute[72019]: WARNING nova.compute.manager [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received unexpected event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance with vm_state building and task_state spawning.
Apr 14 13:12:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received event network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] Acquiring lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] No waiting events found dispatching network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:12:50 user nova-compute[72019]: WARNING nova.compute.manager [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received unexpected event network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 for instance with vm_state building and task_state spawning.
Apr 14 13:12:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received event network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] Acquiring lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] No waiting events found dispatching network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:12:50 user nova-compute[72019]: WARNING nova.compute.manager [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received unexpected event network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 for instance with vm_state building and task_state spawning.
Apr 14 13:12:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-a3309bd9-2c2d-415c-b76e-f48acc267c41 req-1a08b3cd-945d-4b6f-ad1f-4a8cf198e64e service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Received event network-vif-plugged-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a3309bd9-2c2d-415c-b76e-f48acc267c41 req-1a08b3cd-945d-4b6f-ad1f-4a8cf198e64e service nova] Acquiring lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a3309bd9-2c2d-415c-b76e-f48acc267c41 req-1a08b3cd-945d-4b6f-ad1f-4a8cf198e64e service nova] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a3309bd9-2c2d-415c-b76e-f48acc267c41 req-1a08b3cd-945d-4b6f-ad1f-4a8cf198e64e service nova] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-a3309bd9-2c2d-415c-b76e-f48acc267c41 req-1a08b3cd-945d-4b6f-ad1f-4a8cf198e64e service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] No waiting events found dispatching network-vif-plugged-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:12:51 user nova-compute[72019]: WARNING nova.compute.manager [req-a3309bd9-2c2d-415c-b76e-f48acc267c41 req-1a08b3cd-945d-4b6f-ad1f-4a8cf198e64e service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Received unexpected event network-vif-plugged-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 for instance with vm_state building and task_state spawning.
Apr 14 13:12:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477973.12096, cc4631eb-ae5b-4efa-9def-c0c45f56f40f => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:12:53 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] VM Resumed (Lifecycle Event)
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:53 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Instance spawned successfully.
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:53 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477973.1303937, cc4631eb-ae5b-4efa-9def-c0c45f56f40f => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:12:53 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] VM Started (Lifecycle Event)
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:12:53 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:12:53 user nova-compute[72019]: INFO nova.compute.manager [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Took 18.12 seconds to spawn the instance on the hypervisor.
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "c74c3463-6701-4150-9096-1775785e8e2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "c74c3463-6701-4150-9096-1775785e8e2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-f36b4fdf-f19b-4354-8fde-98926d421257 req-22cb5dde-4f76-4bd9-a30d-7afdf198488f service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Received event network-vif-plugged-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f36b4fdf-f19b-4354-8fde-98926d421257 req-22cb5dde-4f76-4bd9-a30d-7afdf198488f service nova] Acquiring lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f36b4fdf-f19b-4354-8fde-98926d421257 req-22cb5dde-4f76-4bd9-a30d-7afdf198488f service nova] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f36b4fdf-f19b-4354-8fde-98926d421257 req-22cb5dde-4f76-4bd9-a30d-7afdf198488f service nova] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-f36b4fdf-f19b-4354-8fde-98926d421257 req-22cb5dde-4f76-4bd9-a30d-7afdf198488f service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] No waiting events found dispatching network-vif-plugged-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:12:53 user nova-compute[72019]: WARNING nova.compute.manager [req-f36b4fdf-f19b-4354-8fde-98926d421257 req-22cb5dde-4f76-4bd9-a30d-7afdf198488f service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Received unexpected event network-vif-plugged-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 for instance with vm_state building and task_state spawning.
Apr 14 13:12:53 user nova-compute[72019]: INFO nova.compute.manager [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Took 19.03 seconds to build instance.
Apr 14 13:12:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.272s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477973.7786906, c34d24a3-a632-4f05-b6fb-dc3562dc93d6 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:12:53 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] VM Resumed (Lifecycle Event)
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:12:53 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Instance spawned successfully.
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:12:53 user nova-compute[72019]: INFO nova.compute.claims [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Claim successful on node user
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:12:53 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477973.7791839, c34d24a3-a632-4f05-b6fb-dc3562dc93d6 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:12:53 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] VM Started (Lifecycle Event)
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:12:53 user nova-compute[72019]: INFO nova.compute.manager [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Took 13.56 seconds to spawn the instance on the hypervisor.
Apr 14 13:12:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:12:53 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:12:54 user nova-compute[72019]: INFO nova.compute.manager [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Took 14.60 seconds to build instance.
Apr 14 13:12:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.736s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:54 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:12:54 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:12:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.777s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:54 user nova-compute[72019]: DEBUG nova.compute.manager [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:12:54 user nova-compute[72019]: DEBUG nova.compute.manager [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:12:54 user nova-compute[72019]: DEBUG nova.network.neutron [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:12:54 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:12:54 user nova-compute[72019]: DEBUG nova.compute.manager [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG nova.policy [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1387c0adbe74072b52886ddc2af4182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9094bc9720194f02abdc6d0b081c7e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG nova.compute.manager [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:12:55 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Creating image(s)
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "/opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "/opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "/opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:12:55 user nova-compute[72019]: INFO nova.compute.claims [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Claim successful on node user
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.275s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.189s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk 1073741824" returned: 0 in 0.124s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.263s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:12:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "e058f6b1-e83b-49af-9ab3-a29b959f211f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "e058f6b1-e83b-49af-9ab3-a29b959f211f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Cannot resize image /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.objects.instance [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lazy-loading 'migration_context' on Instance uuid c74c3463-6701-4150-9096-1775785e8e2a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Ensure instance console log exists: /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "990b083b-744a-42cb-88f3-7ae16a5abed4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.199s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.078s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:12:56 user nova-compute[72019]: INFO nova.compute.claims [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Claim successful on node user
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.network.neutron [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Successfully created port: 81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:12:56 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.policy [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3975df3ad6084eee8bca5aedfc61ac95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14f43e2f82342ddbdb5c4ceedc96936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:12:56 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Creating image(s)
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "/opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "/opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "c8aa91606f037f9e5b01c25f6a567e89fe938607" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "c8aa91606f037f9e5b01c25f6a567e89fe938607" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607.part --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607.part --force-share --output=json" returned: 0 in 0.279s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG nova.virt.images [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 73157366-43fa-48ac-9387-0ba6d7637222 was qcow2, converting to raw {{(pid=72019) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607.part /opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607.converted {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG nova.network.neutron [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Successfully updated port: 81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.369s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.326s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "refresh_cache-c74c3463-6701-4150-9096-1775785e8e2a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquired lock "refresh_cache-c74c3463-6701-4150-9096-1775785e8e2a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG nova.network.neutron [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:12:57 user nova-compute[72019]: INFO nova.compute.claims [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Claim successful on node user
Apr 14 13:12:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607.part /opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607.converted" returned: 0 in 0.201s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607.converted --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-e31ff4cc-0c2e-4912-a69c-97d00ba756c3 req-33967ffa-be05-44b3-908d-6db5ab4cfa82 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Received event network-changed-81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-e31ff4cc-0c2e-4912-a69c-97d00ba756c3 req-33967ffa-be05-44b3-908d-6db5ab4cfa82 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Refreshing instance network info cache due to event network-changed-81acf974-1e47-44a8-822c-3d47187e3ae5. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e31ff4cc-0c2e-4912-a69c-97d00ba756c3 req-33967ffa-be05-44b3-908d-6db5ab4cfa82 service nova] Acquiring lock "refresh_cache-c74c3463-6701-4150-9096-1775785e8e2a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG nova.network.neutron [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:12:57 user nova-compute[72019]: DEBUG nova.network.neutron [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:12:58 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:12:58 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607.converted --force-share --output=json" returned: 0 in 0.227s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "c8aa91606f037f9e5b01c25f6a567e89fe938607" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.245s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607 --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607 --force-share --output=json" returned: 0 in 0.250s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "c8aa91606f037f9e5b01c25f6a567e89fe938607" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "c8aa91606f037f9e5b01c25f6a567e89fe938607" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607 --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG nova.policy [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c4166b50a7c49158acc8684eaee6041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7d361867b4265bd4e1d13e9e66bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:12:58 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Creating image(s)
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "/opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "/opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "/opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607 --force-share --output=json" returned: 0 in 0.226s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607,backing_fmt=raw /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607,backing_fmt=raw /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk 1073741824" returned: 0 in 0.082s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "c8aa91606f037f9e5b01c25f6a567e89fe938607" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607 --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.210s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Successfully created port: c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8aa91606f037f9e5b01c25f6a567e89fe938607 --force-share --output=json" returned: 0 in 0.215s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.123s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.231s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk 1073741824" returned: 0 in 0.075s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.network.neutron [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Cannot resize image /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lazy-loading 'migration_context' on Instance uuid f9b4e51c-b24a-4025-8be1-4294d06c18ff {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:12:59 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Ensure instance console log exists: /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.255s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:12:59 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Creating image(s)
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "/opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "/opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "/opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.policy [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e33a6a8f8f441978437332de5499609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18dfe057a9f742ceb908883f28463a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Cannot resize image /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.objects.instance [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lazy-loading 'migration_context' on Instance uuid e058f6b1-e83b-49af-9ab3-a29b959f211f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Ensure instance console log exists: /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.199s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.network.neutron [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Updating instance_info_cache with network_info: [{"id": "81acf974-1e47-44a8-822c-3d47187e3ae5", "address": "fa:16:3e:86:67:71", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81acf974-1e", "ovs_interfaceid": "81acf974-1e47-44a8-822c-3d47187e3ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Releasing lock "refresh_cache-c74c3463-6701-4150-9096-1775785e8e2a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.compute.manager [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Instance network_info: |[{"id": "81acf974-1e47-44a8-822c-3d47187e3ae5", "address": "fa:16:3e:86:67:71", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81acf974-1e", "ovs_interfaceid": "81acf974-1e47-44a8-822c-3d47187e3ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e31ff4cc-0c2e-4912-a69c-97d00ba756c3 req-33967ffa-be05-44b3-908d-6db5ab4cfa82 service nova] Acquired lock "refresh_cache-c74c3463-6701-4150-9096-1775785e8e2a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.network.neutron [req-e31ff4cc-0c2e-4912-a69c-97d00ba756c3 req-33967ffa-be05-44b3-908d-6db5ab4cfa82 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Refreshing network info cache for port 81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Start _get_guest_xml network_info=[{"id": "81acf974-1e47-44a8-822c-3d47187e3ae5", "address": "fa:16:3e:86:67:71", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81acf974-1e", "ovs_interfaceid": "81acf974-1e47-44a8-822c-3d47187e3ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.network.neutron [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Successfully created port: fe327006-c497-4b3f-8e4a-74a407193cb4 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:12:59 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:12:59 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1633441671',display_name='tempest-VolumesAdminNegativeTest-server-1633441671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1633441671',id=6,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdzdkPoVoit7lM3kjI305ncqTC0UPXvZNd8OkmDGnxotdmDaGo3cP0vK31jvHAe3ky9EBQegBgROUmRg4RyBIdIiQhUaixyXIvR1O427vpvxjKBK1aHC8LxkumxfrfRAQ==',key_name='tempest-keypair-482581034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9094bc9720194f02abdc6d0b081c7e32',ramdisk_id='',reservation_id='r-0umzhlb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1303459042',owner_user_name='tempest-VolumesAdminNegativeTest-1303459042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1387c0adbe74072b52886ddc2af4182',uuid=c74c3463-6701-4150-9096-1775785e8e2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81acf974-1e47-44a8-822c-3d47187e3ae5", "address": "fa:16:3e:86:67:71", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81acf974-1e", "ovs_interfaceid": "81acf974-1e47-44a8-822c-3d47187e3ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Converting VIF {"id": "81acf974-1e47-44a8-822c-3d47187e3ae5", "address": "fa:16:3e:86:67:71", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81acf974-1e", "ovs_interfaceid": "81acf974-1e47-44a8-822c-3d47187e3ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:67:71,bridge_name='br-int',has_traffic_filtering=True,id=81acf974-1e47-44a8-822c-3d47187e3ae5,network=Network(ac0fadd7-d406-42a9-84c3-72fcfa33dc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81acf974-1e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG nova.objects.instance [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lazy-loading 'pci_devices' on Instance uuid c74c3463-6701-4150-9096-1775785e8e2a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:12:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.284s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:13:00 user nova-compute[72019]:   <uuid>c74c3463-6701-4150-9096-1775785e8e2a</uuid>
Apr 14 13:13:00 user nova-compute[72019]:   <name>instance-00000006</name>
Apr 14 13:13:00 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:13:00 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:13:00 user nova-compute[72019]:   <metadata>
Apr 14 13:13:00 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:13:00 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:13:00 user nova-compute[72019]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1633441671</nova:name>
Apr 14 13:13:00 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:12:59</nova:creationTime>
Apr 14 13:13:00 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:13:00 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:13:00 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:13:00 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:13:00 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:13:00 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:13:00 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:13:00 user nova-compute[72019]:       <nova:owner>
Apr 14 13:13:00 user nova-compute[72019]:         <nova:user uuid="f1387c0adbe74072b52886ddc2af4182">tempest-VolumesAdminNegativeTest-1303459042-project-member</nova:user>
Apr 14 13:13:00 user nova-compute[72019]:         <nova:project uuid="9094bc9720194f02abdc6d0b081c7e32">tempest-VolumesAdminNegativeTest-1303459042</nova:project>
Apr 14 13:13:00 user nova-compute[72019]:       </nova:owner>
Apr 14 13:13:00 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:13:00 user nova-compute[72019]:       <nova:ports>
Apr 14 13:13:00 user nova-compute[72019]:         <nova:port uuid="81acf974-1e47-44a8-822c-3d47187e3ae5">
Apr 14 13:13:00 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 13:13:00 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:00 user nova-compute[72019]:       </nova:ports>
Apr 14 13:13:00 user nova-compute[72019]:     </nova:instance>
Apr 14 13:13:00 user nova-compute[72019]:   </metadata>
Apr 14 13:13:00 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:13:00 user nova-compute[72019]:     <system>
Apr 14 13:13:00 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:13:00 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:13:00 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:13:00 user nova-compute[72019]:       <entry name="serial">c74c3463-6701-4150-9096-1775785e8e2a</entry>
Apr 14 13:13:00 user nova-compute[72019]:       <entry name="uuid">c74c3463-6701-4150-9096-1775785e8e2a</entry>
Apr 14 13:13:00 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:13:00 user nova-compute[72019]:     </system>
Apr 14 13:13:00 user nova-compute[72019]:   </sysinfo>
Apr 14 13:13:00 user nova-compute[72019]:   <os>
Apr 14 13:13:00 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:13:00 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:13:00 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:13:00 user nova-compute[72019]:   </os>
Apr 14 13:13:00 user nova-compute[72019]:   <features>
Apr 14 13:13:00 user nova-compute[72019]:     <acpi/>
Apr 14 13:13:00 user nova-compute[72019]:     <apic/>
Apr 14 13:13:00 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:13:00 user nova-compute[72019]:   </features>
Apr 14 13:13:00 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:13:00 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:13:00 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:13:00 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:13:00 user nova-compute[72019]:   </clock>
Apr 14 13:13:00 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:13:00 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:13:00 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:13:00 user nova-compute[72019]:   </cpu>
Apr 14 13:13:00 user nova-compute[72019]:   <devices>
Apr 14 13:13:00 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:13:00 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:13:00 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk"/>
Apr 14 13:13:00 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:13:00 user nova-compute[72019]:     </disk>
Apr 14 13:13:00 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:00 user nova-compute[72019]:       <mac address="fa:16:3e:86:67:71"/>
Apr 14 13:13:00 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:00 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:00 user nova-compute[72019]:       <target dev="tap81acf974-1e"/>
Apr 14 13:13:00 user nova-compute[72019]:     </interface>
Apr 14 13:13:00 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:13:00 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/console.log" append="off"/>
Apr 14 13:13:00 user nova-compute[72019]:     </serial>
Apr 14 13:13:00 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:13:00 user nova-compute[72019]:     <video>
Apr 14 13:13:00 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:00 user nova-compute[72019]:     </video>
Apr 14 13:13:00 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:13:00 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:13:00 user nova-compute[72019]:     </rng>
Apr 14 13:13:00 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:13:00 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:13:00 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:13:00 user nova-compute[72019]:     </memballoon>
Apr 14 13:13:00 user nova-compute[72019]:   </devices>
Apr 14 13:13:00 user nova-compute[72019]: </domain>
Apr 14 13:13:00 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1633441671',display_name='tempest-VolumesAdminNegativeTest-server-1633441671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1633441671',id=6,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdzdkPoVoit7lM3kjI305ncqTC0UPXvZNd8OkmDGnxotdmDaGo3cP0vK31jvHAe3ky9EBQegBgROUmRg4RyBIdIiQhUaixyXIvR1O427vpvxjKBK1aHC8LxkumxfrfRAQ==',key_name='tempest-keypair-482581034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9094bc9720194f02abdc6d0b081c7e32',ramdisk_id='',reservation_id='r-0umzhlb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1303459042',owner_user_name='tempest-VolumesAdminNegativeTest-1303459042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1387c0adbe74072b52886ddc2af4182',uuid=c74c3463-6701-4150-9096-1775785e8e2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81acf974-1e47-44a8-822c-3d47187e3ae5", "address": "fa:16:3e:86:67:71", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81acf974-1e", "ovs_interfaceid": "81acf974-1e47-44a8-822c-3d47187e3ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Converting VIF {"id": "81acf974-1e47-44a8-822c-3d47187e3ae5", "address": "fa:16:3e:86:67:71", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81acf974-1e", "ovs_interfaceid": "81acf974-1e47-44a8-822c-3d47187e3ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:67:71,bridge_name='br-int',has_traffic_filtering=True,id=81acf974-1e47-44a8-822c-3d47187e3ae5,network=Network(ac0fadd7-d406-42a9-84c3-72fcfa33dc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81acf974-1e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG os_vif [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:67:71,bridge_name='br-int',has_traffic_filtering=True,id=81acf974-1e47-44a8-822c-3d47187e3ae5,network=Network(ac0fadd7-d406-42a9-84c3-72fcfa33dc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81acf974-1e') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk 1073741824" returned: 0 in 0.103s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.392s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81acf974-1e, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81acf974-1e, col_values=(('external_ids', {'iface-id': '81acf974-1e47-44a8-822c-3d47187e3ae5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:67:71', 'vm-uuid': 'c74c3463-6701-4150-9096-1775785e8e2a'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:00 user nova-compute[72019]: INFO os_vif [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:67:71,bridge_name='br-int',has_traffic_filtering=True,id=81acf974-1e47-44a8-822c-3d47187e3ae5,network=Network(ac0fadd7-d406-42a9-84c3-72fcfa33dc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81acf974-1e')
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] No VIF found with MAC fa:16:3e:86:67:71, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.262s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Checking if we can resize image /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Successfully updated port: c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Cannot resize image /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.objects.instance [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lazy-loading 'migration_context' on Instance uuid 990b083b-744a-42cb-88f3-7ae16a5abed4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "refresh_cache-f9b4e51c-b24a-4025-8be1-4294d06c18ff" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquired lock "refresh_cache-f9b4e51c-b24a-4025-8be1-4294d06c18ff" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Ensure instance console log exists: /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-294cc461-53c7-431b-bffc-a08aade8119c req-a6fb64e3-04a9-4b36-b403-bcd8652d9199 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Received event network-changed-c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-294cc461-53c7-431b-bffc-a08aade8119c req-a6fb64e3-04a9-4b36-b403-bcd8652d9199 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Refreshing instance network info cache due to event network-changed-c32a1dd7-ca19-4b21-8e75-1581be1c0374. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-294cc461-53c7-431b-bffc-a08aade8119c req-a6fb64e3-04a9-4b36-b403-bcd8652d9199 service nova] Acquiring lock "refresh_cache-f9b4e51c-b24a-4025-8be1-4294d06c18ff" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:00 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.network.neutron [req-e31ff4cc-0c2e-4912-a69c-97d00ba756c3 req-33967ffa-be05-44b3-908d-6db5ab4cfa82 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Updated VIF entry in instance network info cache for port 81acf974-1e47-44a8-822c-3d47187e3ae5. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.network.neutron [req-e31ff4cc-0c2e-4912-a69c-97d00ba756c3 req-33967ffa-be05-44b3-908d-6db5ab4cfa82 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Updating instance_info_cache with network_info: [{"id": "81acf974-1e47-44a8-822c-3d47187e3ae5", "address": "fa:16:3e:86:67:71", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81acf974-1e", "ovs_interfaceid": "81acf974-1e47-44a8-822c-3d47187e3ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e31ff4cc-0c2e-4912-a69c-97d00ba756c3 req-33967ffa-be05-44b3-908d-6db5ab4cfa82 service nova] Releasing lock "refresh_cache-c74c3463-6701-4150-9096-1775785e8e2a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Updating instance_info_cache with network_info: [{"id": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "address": "fa:16:3e:8c:5b:a5", "network": {"id": "8ce2e5cd-683e-4a90-9604-35890337ad09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-140415757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14f43e2f82342ddbdb5c4ceedc96936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a1dd7-ca", "ovs_interfaceid": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Releasing lock "refresh_cache-f9b4e51c-b24a-4025-8be1-4294d06c18ff" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Instance network_info: |[{"id": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "address": "fa:16:3e:8c:5b:a5", "network": {"id": "8ce2e5cd-683e-4a90-9604-35890337ad09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-140415757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14f43e2f82342ddbdb5c4ceedc96936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a1dd7-ca", "ovs_interfaceid": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-294cc461-53c7-431b-bffc-a08aade8119c req-a6fb64e3-04a9-4b36-b403-bcd8652d9199 service nova] Acquired lock "refresh_cache-f9b4e51c-b24a-4025-8be1-4294d06c18ff" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.network.neutron [req-294cc461-53c7-431b-bffc-a08aade8119c req-a6fb64e3-04a9-4b36-b403-bcd8652d9199 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Refreshing network info cache for port c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Start _get_guest_xml network_info=[{"id": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "address": "fa:16:3e:8c:5b:a5", "network": {"id": "8ce2e5cd-683e-4a90-9604-35890337ad09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-140415757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14f43e2f82342ddbdb5c4ceedc96936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a1dd7-ca", "ovs_interfaceid": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:12:40Z,direct_url=<?>,disk_format='qcow2',id=73157366-43fa-48ac-9387-0ba6d7637222,min_disk=0,min_ram=0,name='',owner='f652aa60670c485599eafd2b22948387',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:12:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'guest_format': None, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '73157366-43fa-48ac-9387-0ba6d7637222'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:13:01 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:01 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:12:40Z,direct_url=<?>,disk_format='qcow2',id=73157366-43fa-48ac-9387-0ba6d7637222,min_disk=0,min_ram=0,name='',owner='f652aa60670c485599eafd2b22948387',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:12:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1273980598',display_name='tempest-AttachSCSIVolumeTestJSON-server-1273980598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1273980598',id=7,image_ref='73157366-43fa-48ac-9387-0ba6d7637222',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYxk3GOGAG1sfjFiKz6paSv75v5clPigzUPtC8TeGwkIXNOYkWyvxuoItEv01kSH+0A15Mo9E2wd5OTeLGrgiAO+AQs620zYYvv7HS9vO8qQablNjVt9SJHTDMlXo19fA==',key_name='tempest-keypair-1829584132',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14f43e2f82342ddbdb5c4ceedc96936',ramdisk_id='',reservation_id='r-ecsk4ok2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73157366-43fa-48ac-9387-0ba6d7637222',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-167485890',owner_user_name='tempest-AttachSCSIVolumeTestJSON-167485890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3975df3ad6084eee8bca5aedfc61ac95',uuid=f9b4e51c-b24a-4025-8be1-4294d06c18ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "address": "fa:16:3e:8c:5b:a5", "network": {"id": "8ce2e5cd-683e-4a90-9604-35890337ad09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-140415757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14f43e2f82342ddbdb5c4ceedc96936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a1dd7-ca", "ovs_interfaceid": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Converting VIF {"id": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "address": "fa:16:3e:8c:5b:a5", "network": {"id": "8ce2e5cd-683e-4a90-9604-35890337ad09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-140415757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14f43e2f82342ddbdb5c4ceedc96936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a1dd7-ca", "ovs_interfaceid": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:5b:a5,bridge_name='br-int',has_traffic_filtering=True,id=c32a1dd7-ca19-4b21-8e75-1581be1c0374,network=Network(8ce2e5cd-683e-4a90-9604-35890337ad09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32a1dd7-ca') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lazy-loading 'pci_devices' on Instance uuid f9b4e51c-b24a-4025-8be1-4294d06c18ff {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:13:01 user nova-compute[72019]:   <uuid>f9b4e51c-b24a-4025-8be1-4294d06c18ff</uuid>
Apr 14 13:13:01 user nova-compute[72019]:   <name>instance-00000007</name>
Apr 14 13:13:01 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:13:01 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:13:01 user nova-compute[72019]:   <metadata>
Apr 14 13:13:01 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:13:01 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:13:01 user nova-compute[72019]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1273980598</nova:name>
Apr 14 13:13:01 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:13:01</nova:creationTime>
Apr 14 13:13:01 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:13:01 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:13:01 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:13:01 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:13:01 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:13:01 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:13:01 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:13:01 user nova-compute[72019]:       <nova:owner>
Apr 14 13:13:01 user nova-compute[72019]:         <nova:user uuid="3975df3ad6084eee8bca5aedfc61ac95">tempest-AttachSCSIVolumeTestJSON-167485890-project-member</nova:user>
Apr 14 13:13:01 user nova-compute[72019]:         <nova:project uuid="c14f43e2f82342ddbdb5c4ceedc96936">tempest-AttachSCSIVolumeTestJSON-167485890</nova:project>
Apr 14 13:13:01 user nova-compute[72019]:       </nova:owner>
Apr 14 13:13:01 user nova-compute[72019]:       <nova:root type="image" uuid="73157366-43fa-48ac-9387-0ba6d7637222"/>
Apr 14 13:13:01 user nova-compute[72019]:       <nova:ports>
Apr 14 13:13:01 user nova-compute[72019]:         <nova:port uuid="c32a1dd7-ca19-4b21-8e75-1581be1c0374">
Apr 14 13:13:01 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 13:13:01 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:01 user nova-compute[72019]:       </nova:ports>
Apr 14 13:13:01 user nova-compute[72019]:     </nova:instance>
Apr 14 13:13:01 user nova-compute[72019]:   </metadata>
Apr 14 13:13:01 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:13:01 user nova-compute[72019]:     <system>
Apr 14 13:13:01 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:13:01 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:13:01 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:13:01 user nova-compute[72019]:       <entry name="serial">f9b4e51c-b24a-4025-8be1-4294d06c18ff</entry>
Apr 14 13:13:01 user nova-compute[72019]:       <entry name="uuid">f9b4e51c-b24a-4025-8be1-4294d06c18ff</entry>
Apr 14 13:13:01 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:13:01 user nova-compute[72019]:     </system>
Apr 14 13:13:01 user nova-compute[72019]:   </sysinfo>
Apr 14 13:13:01 user nova-compute[72019]:   <os>
Apr 14 13:13:01 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:13:01 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:13:01 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:13:01 user nova-compute[72019]:   </os>
Apr 14 13:13:01 user nova-compute[72019]:   <features>
Apr 14 13:13:01 user nova-compute[72019]:     <acpi/>
Apr 14 13:13:01 user nova-compute[72019]:     <apic/>
Apr 14 13:13:01 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:13:01 user nova-compute[72019]:   </features>
Apr 14 13:13:01 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:13:01 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:13:01 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:13:01 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:13:01 user nova-compute[72019]:   </clock>
Apr 14 13:13:01 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:13:01 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:13:01 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:13:01 user nova-compute[72019]:   </cpu>
Apr 14 13:13:01 user nova-compute[72019]:   <devices>
Apr 14 13:13:01 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:13:01 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:13:01 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk"/>
Apr 14 13:13:01 user nova-compute[72019]:       <target dev="sda" bus="scsi"/>
Apr 14 13:13:01 user nova-compute[72019]:       <address type="drive" controller="0" unit="0"/>
Apr 14 13:13:01 user nova-compute[72019]:     </disk>
Apr 14 13:13:01 user nova-compute[72019]:     <disk type="file" device="cdrom">
Apr 14 13:13:01 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 13:13:01 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk.config"/>
Apr 14 13:13:01 user nova-compute[72019]:       <target dev="sdb" bus="scsi"/>
Apr 14 13:13:01 user nova-compute[72019]:       <address type="drive" controller="0" unit="1"/>
Apr 14 13:13:01 user nova-compute[72019]:     </disk>
Apr 14 13:13:01 user nova-compute[72019]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 14 13:13:01 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:01 user nova-compute[72019]:       <mac address="fa:16:3e:8c:5b:a5"/>
Apr 14 13:13:01 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:01 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:01 user nova-compute[72019]:       <target dev="tapc32a1dd7-ca"/>
Apr 14 13:13:01 user nova-compute[72019]:     </interface>
Apr 14 13:13:01 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:13:01 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/console.log" append="off"/>
Apr 14 13:13:01 user nova-compute[72019]:     </serial>
Apr 14 13:13:01 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:13:01 user nova-compute[72019]:     <video>
Apr 14 13:13:01 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:01 user nova-compute[72019]:     </video>
Apr 14 13:13:01 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:13:01 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:13:01 user nova-compute[72019]:     </rng>
Apr 14 13:13:01 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:13:01 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:13:01 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:13:01 user nova-compute[72019]:     </memballoon>
Apr 14 13:13:01 user nova-compute[72019]:   </devices>
Apr 14 13:13:01 user nova-compute[72019]: </domain>
Apr 14 13:13:01 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1273980598',display_name='tempest-AttachSCSIVolumeTestJSON-server-1273980598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1273980598',id=7,image_ref='73157366-43fa-48ac-9387-0ba6d7637222',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYxk3GOGAG1sfjFiKz6paSv75v5clPigzUPtC8TeGwkIXNOYkWyvxuoItEv01kSH+0A15Mo9E2wd5OTeLGrgiAO+AQs620zYYvv7HS9vO8qQablNjVt9SJHTDMlXo19fA==',key_name='tempest-keypair-1829584132',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14f43e2f82342ddbdb5c4ceedc96936',ramdisk_id='',reservation_id='r-ecsk4ok2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73157366-43fa-48ac-9387-0ba6d7637222',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-167485890',owner_user_name='tempest-AttachSCSIVolumeTestJSON-167485890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3975df3ad6084eee8bca5aedfc61ac95',uuid=f9b4e51c-b24a-4025-8be1-4294d06c18ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "address": "fa:16:3e:8c:5b:a5", "network": {"id": "8ce2e5cd-683e-4a90-9604-35890337ad09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-140415757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14f43e2f82342ddbdb5c4ceedc96936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a1dd7-ca", "ovs_interfaceid": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Converting VIF {"id": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "address": "fa:16:3e:8c:5b:a5", "network": {"id": "8ce2e5cd-683e-4a90-9604-35890337ad09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-140415757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14f43e2f82342ddbdb5c4ceedc96936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a1dd7-ca", "ovs_interfaceid": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:5b:a5,bridge_name='br-int',has_traffic_filtering=True,id=c32a1dd7-ca19-4b21-8e75-1581be1c0374,network=Network(8ce2e5cd-683e-4a90-9604-35890337ad09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32a1dd7-ca') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG os_vif [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:5b:a5,bridge_name='br-int',has_traffic_filtering=True,id=c32a1dd7-ca19-4b21-8e75-1581be1c0374,network=Network(8ce2e5cd-683e-4a90-9604-35890337ad09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32a1dd7-ca') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc32a1dd7-ca, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc32a1dd7-ca, col_values=(('external_ids', {'iface-id': 'c32a1dd7-ca19-4b21-8e75-1581be1c0374', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:5b:a5', 'vm-uuid': 'f9b4e51c-b24a-4025-8be1-4294d06c18ff'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:01 user nova-compute[72019]: INFO os_vif [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:5b:a5,bridge_name='br-int',has_traffic_filtering=True,id=c32a1dd7-ca19-4b21-8e75-1581be1c0374,network=Network(8ce2e5cd-683e-4a90-9604-35890337ad09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32a1dd7-ca')
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] No BDM found with device name sda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] No VIF found with MAC fa:16:3e:8c:5b:a5, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:13:01 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Using config drive
Apr 14 13:13:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG nova.network.neutron [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Successfully updated port: fe327006-c497-4b3f-8e4a-74a407193cb4 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:02 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Creating config drive at /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk.config
Apr 14 13:13:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8wmwf_z2 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "refresh_cache-e058f6b1-e83b-49af-9ab3-a29b959f211f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquired lock "refresh_cache-e058f6b1-e83b-49af-9ab3-a29b959f211f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG nova.network.neutron [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG nova.compute.manager [req-a8336bbd-b32b-47cb-9c11-90ffdafa3cfb req-9d9346fb-1dff-4bd4-be7c-06c561bb1e6b service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Received event network-changed-fe327006-c497-4b3f-8e4a-74a407193cb4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG nova.compute.manager [req-a8336bbd-b32b-47cb-9c11-90ffdafa3cfb req-9d9346fb-1dff-4bd4-be7c-06c561bb1e6b service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Refreshing instance network info cache due to event network-changed-fe327006-c497-4b3f-8e4a-74a407193cb4. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a8336bbd-b32b-47cb-9c11-90ffdafa3cfb req-9d9346fb-1dff-4bd4-be7c-06c561bb1e6b service nova] Acquiring lock "refresh_cache-e058f6b1-e83b-49af-9ab3-a29b959f211f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8wmwf_z2" returned: 0 in 0.240s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG nova.network.neutron [req-294cc461-53c7-431b-bffc-a08aade8119c req-a6fb64e3-04a9-4b36-b403-bcd8652d9199 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Updated VIF entry in instance network info cache for port c32a1dd7-ca19-4b21-8e75-1581be1c0374. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG nova.network.neutron [req-294cc461-53c7-431b-bffc-a08aade8119c req-a6fb64e3-04a9-4b36-b403-bcd8652d9199 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Updating instance_info_cache with network_info: [{"id": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "address": "fa:16:3e:8c:5b:a5", "network": {"id": "8ce2e5cd-683e-4a90-9604-35890337ad09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-140415757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14f43e2f82342ddbdb5c4ceedc96936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a1dd7-ca", "ovs_interfaceid": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-294cc461-53c7-431b-bffc-a08aade8119c req-a6fb64e3-04a9-4b36-b403-bcd8652d9199 service nova] Releasing lock "refresh_cache-f9b4e51c-b24a-4025-8be1-4294d06c18ff" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG nova.network.neutron [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:13:02 user nova-compute[72019]: INFO nova.compute.claims [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Claim successful on node user
Apr 14 13:13:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.network.neutron [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Updating instance_info_cache with network_info: [{"id": "fe327006-c497-4b3f-8e4a-74a407193cb4", "address": "fa:16:3e:f1:0c:e5", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe327006-c4", "ovs_interfaceid": "fe327006-c497-4b3f-8e4a-74a407193cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Releasing lock "refresh_cache-e058f6b1-e83b-49af-9ab3-a29b959f211f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Instance network_info: |[{"id": "fe327006-c497-4b3f-8e4a-74a407193cb4", "address": "fa:16:3e:f1:0c:e5", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe327006-c4", "ovs_interfaceid": "fe327006-c497-4b3f-8e4a-74a407193cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a8336bbd-b32b-47cb-9c11-90ffdafa3cfb req-9d9346fb-1dff-4bd4-be7c-06c561bb1e6b service nova] Acquired lock "refresh_cache-e058f6b1-e83b-49af-9ab3-a29b959f211f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.network.neutron [req-a8336bbd-b32b-47cb-9c11-90ffdafa3cfb req-9d9346fb-1dff-4bd4-be7c-06c561bb1e6b service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Refreshing network info cache for port fe327006-c497-4b3f-8e4a-74a407193cb4 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Start _get_guest_xml network_info=[{"id": "fe327006-c497-4b3f-8e4a-74a407193cb4", "address": "fa:16:3e:f1:0c:e5", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe327006-c4", "ovs_interfaceid": "fe327006-c497-4b3f-8e4a-74a407193cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:13:03 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:03 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2141644410',display_name='tempest-VolumesActionsTest-instance-2141644410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2141644410',id=8,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1c7d361867b4265bd4e1d13e9e66bc4',ramdisk_id='',reservation_id='r-mvx0x4bp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2125520108',owner_user_name='tempest-VolumesActionsTest-2125520108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:58Z,user_data=None,user_id='1c4166b50a7c49158acc8684eaee6041',uuid=e058f6b1-e83b-49af-9ab3-a29b959f211f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe327006-c497-4b3f-8e4a-74a407193cb4", "address": "fa:16:3e:f1:0c:e5", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe327006-c4", "ovs_interfaceid": "fe327006-c497-4b3f-8e4a-74a407193cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Converting VIF {"id": "fe327006-c497-4b3f-8e4a-74a407193cb4", "address": "fa:16:3e:f1:0c:e5", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe327006-c4", "ovs_interfaceid": "fe327006-c497-4b3f-8e4a-74a407193cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:0c:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe327006-c497-4b3f-8e4a-74a407193cb4,network=Network(c6dfe7b8-e16e-4c31-93b7-9e358f72de7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe327006-c4') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.objects.instance [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lazy-loading 'pci_devices' on Instance uuid e058f6b1-e83b-49af-9ab3-a29b959f211f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:13:03 user nova-compute[72019]:   <uuid>e058f6b1-e83b-49af-9ab3-a29b959f211f</uuid>
Apr 14 13:13:03 user nova-compute[72019]:   <name>instance-00000008</name>
Apr 14 13:13:03 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:13:03 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:13:03 user nova-compute[72019]:   <metadata>
Apr 14 13:13:03 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:13:03 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:13:03 user nova-compute[72019]:       <nova:name>tempest-VolumesActionsTest-instance-2141644410</nova:name>
Apr 14 13:13:03 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:13:03</nova:creationTime>
Apr 14 13:13:03 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:13:03 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:13:03 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:13:03 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:13:03 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:13:03 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:13:03 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:13:03 user nova-compute[72019]:       <nova:owner>
Apr 14 13:13:03 user nova-compute[72019]:         <nova:user uuid="1c4166b50a7c49158acc8684eaee6041">tempest-VolumesActionsTest-2125520108-project-member</nova:user>
Apr 14 13:13:03 user nova-compute[72019]:         <nova:project uuid="e1c7d361867b4265bd4e1d13e9e66bc4">tempest-VolumesActionsTest-2125520108</nova:project>
Apr 14 13:13:03 user nova-compute[72019]:       </nova:owner>
Apr 14 13:13:03 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:13:03 user nova-compute[72019]:       <nova:ports>
Apr 14 13:13:03 user nova-compute[72019]:         <nova:port uuid="fe327006-c497-4b3f-8e4a-74a407193cb4">
Apr 14 13:13:03 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 13:13:03 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:03 user nova-compute[72019]:       </nova:ports>
Apr 14 13:13:03 user nova-compute[72019]:     </nova:instance>
Apr 14 13:13:03 user nova-compute[72019]:   </metadata>
Apr 14 13:13:03 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:13:03 user nova-compute[72019]:     <system>
Apr 14 13:13:03 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:13:03 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:13:03 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:13:03 user nova-compute[72019]:       <entry name="serial">e058f6b1-e83b-49af-9ab3-a29b959f211f</entry>
Apr 14 13:13:03 user nova-compute[72019]:       <entry name="uuid">e058f6b1-e83b-49af-9ab3-a29b959f211f</entry>
Apr 14 13:13:03 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:13:03 user nova-compute[72019]:     </system>
Apr 14 13:13:03 user nova-compute[72019]:   </sysinfo>
Apr 14 13:13:03 user nova-compute[72019]:   <os>
Apr 14 13:13:03 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:13:03 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:13:03 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:13:03 user nova-compute[72019]:   </os>
Apr 14 13:13:03 user nova-compute[72019]:   <features>
Apr 14 13:13:03 user nova-compute[72019]:     <acpi/>
Apr 14 13:13:03 user nova-compute[72019]:     <apic/>
Apr 14 13:13:03 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:13:03 user nova-compute[72019]:   </features>
Apr 14 13:13:03 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:13:03 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:13:03 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:13:03 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:13:03 user nova-compute[72019]:   </clock>
Apr 14 13:13:03 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:13:03 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:13:03 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:13:03 user nova-compute[72019]:   </cpu>
Apr 14 13:13:03 user nova-compute[72019]:   <devices>
Apr 14 13:13:03 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:13:03 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:13:03 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk"/>
Apr 14 13:13:03 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:13:03 user nova-compute[72019]:     </disk>
Apr 14 13:13:03 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:03 user nova-compute[72019]:       <mac address="fa:16:3e:f1:0c:e5"/>
Apr 14 13:13:03 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:03 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:03 user nova-compute[72019]:       <target dev="tapfe327006-c4"/>
Apr 14 13:13:03 user nova-compute[72019]:     </interface>
Apr 14 13:13:03 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:13:03 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/console.log" append="off"/>
Apr 14 13:13:03 user nova-compute[72019]:     </serial>
Apr 14 13:13:03 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:13:03 user nova-compute[72019]:     <video>
Apr 14 13:13:03 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:03 user nova-compute[72019]:     </video>
Apr 14 13:13:03 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:13:03 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:13:03 user nova-compute[72019]:     </rng>
Apr 14 13:13:03 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:13:03 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:13:03 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:13:03 user nova-compute[72019]:     </memballoon>
Apr 14 13:13:03 user nova-compute[72019]:   </devices>
Apr 14 13:13:03 user nova-compute[72019]: </domain>
Apr 14 13:13:03 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2141644410',display_name='tempest-VolumesActionsTest-instance-2141644410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2141644410',id=8,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1c7d361867b4265bd4e1d13e9e66bc4',ramdisk_id='',reservation_id='r-mvx0x4bp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2125520108',owner_user_name='tempest-VolumesActionsTest-2125520108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:58Z,user_data=None,user_id='1c4166b50a7c49158acc8684eaee6041',uuid=e058f6b1-e83b-49af-9ab3-a29b959f211f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe327006-c497-4b3f-8e4a-74a407193cb4", "address": "fa:16:3e:f1:0c:e5", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe327006-c4", "ovs_interfaceid": "fe327006-c497-4b3f-8e4a-74a407193cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Converting VIF {"id": "fe327006-c497-4b3f-8e4a-74a407193cb4", "address": "fa:16:3e:f1:0c:e5", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe327006-c4", "ovs_interfaceid": "fe327006-c497-4b3f-8e4a-74a407193cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:0c:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe327006-c497-4b3f-8e4a-74a407193cb4,network=Network(c6dfe7b8-e16e-4c31-93b7-9e358f72de7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe327006-c4') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG os_vif [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:0c:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe327006-c497-4b3f-8e4a-74a407193cb4,network=Network(c6dfe7b8-e16e-4c31-93b7-9e358f72de7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe327006-c4') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe327006-c4, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe327006-c4, col_values=(('external_ids', {'iface-id': 'fe327006-c497-4b3f-8e4a-74a407193cb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:0c:e5', 'vm-uuid': 'e058f6b1-e83b-49af-9ab3-a29b959f211f'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:03 user nova-compute[72019]: INFO os_vif [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:0c:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe327006-c497-4b3f-8e4a-74a407193cb4,network=Network(c6dfe7b8-e16e-4c31-93b7-9e358f72de7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe327006-c4')
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] No VIF found with MAC fa:16:3e:f1:0c:e5, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.network.neutron [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Successfully created port: 932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:13:03 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.policy [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '016ee10024d2449c93d67e0b14f09f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a7e094618456381891d4532bb3cf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:13:03 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Creating image(s)
Apr 14 13:13:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.270s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.159s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG nova.network.neutron [req-a8336bbd-b32b-47cb-9c11-90ffdafa3cfb req-9d9346fb-1dff-4bd4-be7c-06c561bb1e6b service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Updated VIF entry in instance network info cache for port fe327006-c497-4b3f-8e4a-74a407193cb4. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG nova.network.neutron [req-a8336bbd-b32b-47cb-9c11-90ffdafa3cfb req-9d9346fb-1dff-4bd4-be7c-06c561bb1e6b service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Updating instance_info_cache with network_info: [{"id": "fe327006-c497-4b3f-8e4a-74a407193cb4", "address": "fa:16:3e:f1:0c:e5", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe327006-c4", "ovs_interfaceid": "fe327006-c497-4b3f-8e4a-74a407193cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG nova.compute.manager [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Received event network-vif-plugged-81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] Acquiring lock "c74c3463-6701-4150-9096-1775785e8e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] Lock "c74c3463-6701-4150-9096-1775785e8e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] Lock "c74c3463-6701-4150-9096-1775785e8e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG nova.compute.manager [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] No waiting events found dispatching network-vif-plugged-81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:04 user nova-compute[72019]: WARNING nova.compute.manager [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Received unexpected event network-vif-plugged-81acf974-1e47-44a8-822c-3d47187e3ae5 for instance with vm_state building and task_state spawning.
Apr 14 13:13:04 user nova-compute[72019]: DEBUG nova.compute.manager [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Received event network-vif-plugged-81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] Acquiring lock "c74c3463-6701-4150-9096-1775785e8e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] Lock "c74c3463-6701-4150-9096-1775785e8e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] Lock "c74c3463-6701-4150-9096-1775785e8e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG nova.compute.manager [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] No waiting events found dispatching network-vif-plugged-81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:04 user nova-compute[72019]: WARNING nova.compute.manager [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Received unexpected event network-vif-plugged-81acf974-1e47-44a8-822c-3d47187e3ae5 for instance with vm_state building and task_state spawning.
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a8336bbd-b32b-47cb-9c11-90ffdafa3cfb req-9d9346fb-1dff-4bd4-be7c-06c561bb1e6b service nova] Releasing lock "refresh_cache-e058f6b1-e83b-49af-9ab3-a29b959f211f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk 1073741824" returned: 0 in 0.088s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG nova.compute.manager [req-7b33eb3f-9b65-46e3-a339-7f54b8aa23f8 req-9163ede4-742d-40f3-bcbd-7dd13a8944e2 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Received event network-vif-plugged-c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7b33eb3f-9b65-46e3-a339-7f54b8aa23f8 req-9163ede4-742d-40f3-bcbd-7dd13a8944e2 service nova] Acquiring lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7b33eb3f-9b65-46e3-a339-7f54b8aa23f8 req-9163ede4-742d-40f3-bcbd-7dd13a8944e2 service nova] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7b33eb3f-9b65-46e3-a339-7f54b8aa23f8 req-9163ede4-742d-40f3-bcbd-7dd13a8944e2 service nova] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG nova.compute.manager [req-7b33eb3f-9b65-46e3-a339-7f54b8aa23f8 req-9163ede4-742d-40f3-bcbd-7dd13a8944e2 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] No waiting events found dispatching network-vif-plugged-c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:04 user nova-compute[72019]: WARNING nova.compute.manager [req-7b33eb3f-9b65-46e3-a339-7f54b8aa23f8 req-9163ede4-742d-40f3-bcbd-7dd13a8944e2 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Received unexpected event network-vif-plugged-c32a1dd7-ca19-4b21-8e75-1581be1c0374 for instance with vm_state building and task_state spawning.
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.175s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Cannot resize image /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lazy-loading 'migration_context' on Instance uuid 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Ensure instance console log exists: /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:05 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Successfully created port: 0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:13:05 user nova-compute[72019]: DEBUG nova.network.neutron [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Successfully updated port: 932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "refresh_cache-990b083b-744a-42cb-88f3-7ae16a5abed4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquired lock "refresh_cache-990b083b-744a-42cb-88f3-7ae16a5abed4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:05 user nova-compute[72019]: DEBUG nova.network.neutron [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:13:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-3b49996e-d296-4f24-b9b9-95d34e89cf19 req-ddc7671b-85d2-4266-a60a-7102b1822c79 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Received event network-changed-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-3b49996e-d296-4f24-b9b9-95d34e89cf19 req-ddc7671b-85d2-4266-a60a-7102b1822c79 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Refreshing instance network info cache due to event network-changed-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3b49996e-d296-4f24-b9b9-95d34e89cf19 req-ddc7671b-85d2-4266-a60a-7102b1822c79 service nova] Acquiring lock "refresh_cache-990b083b-744a-42cb-88f3-7ae16a5abed4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.network.neutron [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.compute.manager [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477986.4493365, c74c3463-6701-4150-9096-1775785e8e2a => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:06 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c74c3463-6701-4150-9096-1775785e8e2a] VM Resumed (Lifecycle Event)
Apr 14 13:13:06 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Instance spawned successfully.
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:06 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c74c3463-6701-4150-9096-1775785e8e2a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477986.4496274, c74c3463-6701-4150-9096-1775785e8e2a => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:06 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c74c3463-6701-4150-9096-1775785e8e2a] VM Started (Lifecycle Event)
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Successfully updated port: 0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:06 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: c74c3463-6701-4150-9096-1775785e8e2a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquired lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Received event network-vif-plugged-c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] Acquiring lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] No waiting events found dispatching network-vif-plugged-c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:06 user nova-compute[72019]: WARNING nova.compute.manager [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Received unexpected event network-vif-plugged-c32a1dd7-ca19-4b21-8e75-1581be1c0374 for instance with vm_state building and task_state spawning.
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received event network-changed-0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Refreshing instance network info cache due to event network-changed-0946e034-1e6c-42d6-a8e2-1b24fabc000c. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] Acquiring lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:06 user nova-compute[72019]: INFO nova.compute.manager [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Took 11.67 seconds to spawn the instance on the hypervisor.
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.compute.manager [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:06 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:06 user nova-compute[72019]: INFO nova.compute.manager [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Took 13.13 seconds to build instance.
Apr 14 13:13:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "c74c3463-6701-4150-9096-1775785e8e2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.403s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.network.neutron [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Updating instance_info_cache with network_info: [{"id": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "address": "fa:16:3e:d5:ed:2c", "network": {"id": "a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972", "bridge": "br-int", "label": "tempest-TestVolumeSwap-715659165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dfe057a9f742ceb908883f28463a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932d0b4b-da", "ovs_interfaceid": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Releasing lock "refresh_cache-990b083b-744a-42cb-88f3-7ae16a5abed4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Instance network_info: |[{"id": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "address": "fa:16:3e:d5:ed:2c", "network": {"id": "a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972", "bridge": "br-int", "label": "tempest-TestVolumeSwap-715659165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dfe057a9f742ceb908883f28463a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932d0b4b-da", "ovs_interfaceid": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3b49996e-d296-4f24-b9b9-95d34e89cf19 req-ddc7671b-85d2-4266-a60a-7102b1822c79 service nova] Acquired lock "refresh_cache-990b083b-744a-42cb-88f3-7ae16a5abed4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.network.neutron [req-3b49996e-d296-4f24-b9b9-95d34e89cf19 req-ddc7671b-85d2-4266-a60a-7102b1822c79 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Refreshing network info cache for port 932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Start _get_guest_xml network_info=[{"id": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "address": "fa:16:3e:d5:ed:2c", "network": {"id": "a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972", "bridge": "br-int", "label": "tempest-TestVolumeSwap-715659165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dfe057a9f742ceb908883f28463a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932d0b4b-da", "ovs_interfaceid": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:13:07 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:07 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2039788772',display_name='tempest-TestVolumeSwap-server-2039788772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2039788772',id=9,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQGkfzhrgRQt3R+2yTZx1eIPdWpktZ8TGxkXnf/ktvKVPNojK9B8SUmMt34Q3Xrk7GLPxqU8Sg3MgwUeKs/D2/0ZoXxgbSLa7+dKYceaNQ0dza/dcfmvf3TnWbFUP+mKQ==',key_name='tempest-keypair-157168234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18dfe057a9f742ceb908883f28463a43',ramdisk_id='',reservation_id='r-bq64jr81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1055532166',owner_user_name='tempest-TestVolumeSwap-1055532166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e33a6a8f8f441978437332de5499609',uuid=990b083b-744a-42cb-88f3-7ae16a5abed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "address": "fa:16:3e:d5:ed:2c", "network": {"id": "a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972", "bridge": "br-int", "label": "tempest-TestVolumeSwap-715659165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dfe057a9f742ceb908883f28463a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932d0b4b-da", "ovs_interfaceid": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Converting VIF {"id": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "address": "fa:16:3e:d5:ed:2c", "network": {"id": "a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972", "bridge": "br-int", "label": "tempest-TestVolumeSwap-715659165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dfe057a9f742ceb908883f28463a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932d0b4b-da", "ovs_interfaceid": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:ed:2c,bridge_name='br-int',has_traffic_filtering=True,id=932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3,network=Network(a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932d0b4b-da') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.objects.instance [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lazy-loading 'pci_devices' on Instance uuid 990b083b-744a-42cb-88f3-7ae16a5abed4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:13:07 user nova-compute[72019]:   <uuid>990b083b-744a-42cb-88f3-7ae16a5abed4</uuid>
Apr 14 13:13:07 user nova-compute[72019]:   <name>instance-00000009</name>
Apr 14 13:13:07 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:13:07 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:13:07 user nova-compute[72019]:   <metadata>
Apr 14 13:13:07 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:13:07 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:13:07 user nova-compute[72019]:       <nova:name>tempest-TestVolumeSwap-server-2039788772</nova:name>
Apr 14 13:13:07 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:13:07</nova:creationTime>
Apr 14 13:13:07 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:13:07 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:13:07 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:13:07 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:13:07 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:13:07 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:13:07 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:13:07 user nova-compute[72019]:       <nova:owner>
Apr 14 13:13:07 user nova-compute[72019]:         <nova:user uuid="8e33a6a8f8f441978437332de5499609">tempest-TestVolumeSwap-1055532166-project-member</nova:user>
Apr 14 13:13:07 user nova-compute[72019]:         <nova:project uuid="18dfe057a9f742ceb908883f28463a43">tempest-TestVolumeSwap-1055532166</nova:project>
Apr 14 13:13:07 user nova-compute[72019]:       </nova:owner>
Apr 14 13:13:07 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:13:07 user nova-compute[72019]:       <nova:ports>
Apr 14 13:13:07 user nova-compute[72019]:         <nova:port uuid="932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3">
Apr 14 13:13:07 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 13:13:07 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:07 user nova-compute[72019]:       </nova:ports>
Apr 14 13:13:07 user nova-compute[72019]:     </nova:instance>
Apr 14 13:13:07 user nova-compute[72019]:   </metadata>
Apr 14 13:13:07 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:13:07 user nova-compute[72019]:     <system>
Apr 14 13:13:07 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:13:07 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:13:07 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:13:07 user nova-compute[72019]:       <entry name="serial">990b083b-744a-42cb-88f3-7ae16a5abed4</entry>
Apr 14 13:13:07 user nova-compute[72019]:       <entry name="uuid">990b083b-744a-42cb-88f3-7ae16a5abed4</entry>
Apr 14 13:13:07 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:13:07 user nova-compute[72019]:     </system>
Apr 14 13:13:07 user nova-compute[72019]:   </sysinfo>
Apr 14 13:13:07 user nova-compute[72019]:   <os>
Apr 14 13:13:07 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:13:07 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:13:07 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:13:07 user nova-compute[72019]:   </os>
Apr 14 13:13:07 user nova-compute[72019]:   <features>
Apr 14 13:13:07 user nova-compute[72019]:     <acpi/>
Apr 14 13:13:07 user nova-compute[72019]:     <apic/>
Apr 14 13:13:07 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:13:07 user nova-compute[72019]:   </features>
Apr 14 13:13:07 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:13:07 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:13:07 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:13:07 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:13:07 user nova-compute[72019]:   </clock>
Apr 14 13:13:07 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:13:07 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:13:07 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:13:07 user nova-compute[72019]:   </cpu>
Apr 14 13:13:07 user nova-compute[72019]:   <devices>
Apr 14 13:13:07 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:13:07 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:13:07 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk"/>
Apr 14 13:13:07 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:13:07 user nova-compute[72019]:     </disk>
Apr 14 13:13:07 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:07 user nova-compute[72019]:       <mac address="fa:16:3e:d5:ed:2c"/>
Apr 14 13:13:07 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:07 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:07 user nova-compute[72019]:       <target dev="tap932d0b4b-da"/>
Apr 14 13:13:07 user nova-compute[72019]:     </interface>
Apr 14 13:13:07 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:13:07 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/console.log" append="off"/>
Apr 14 13:13:07 user nova-compute[72019]:     </serial>
Apr 14 13:13:07 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:13:07 user nova-compute[72019]:     <video>
Apr 14 13:13:07 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:07 user nova-compute[72019]:     </video>
Apr 14 13:13:07 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:13:07 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:13:07 user nova-compute[72019]:     </rng>
Apr 14 13:13:07 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:13:07 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:13:07 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:13:07 user nova-compute[72019]:     </memballoon>
Apr 14 13:13:07 user nova-compute[72019]:   </devices>
Apr 14 13:13:07 user nova-compute[72019]: </domain>
Apr 14 13:13:07 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2039788772',display_name='tempest-TestVolumeSwap-server-2039788772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2039788772',id=9,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQGkfzhrgRQt3R+2yTZx1eIPdWpktZ8TGxkXnf/ktvKVPNojK9B8SUmMt34Q3Xrk7GLPxqU8Sg3MgwUeKs/D2/0ZoXxgbSLa7+dKYceaNQ0dza/dcfmvf3TnWbFUP+mKQ==',key_name='tempest-keypair-157168234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18dfe057a9f742ceb908883f28463a43',ramdisk_id='',reservation_id='r-bq64jr81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1055532166',owner_user_name='tempest-TestVolumeSwap-1055532166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e33a6a8f8f441978437332de5499609',uuid=990b083b-744a-42cb-88f3-7ae16a5abed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "address": "fa:16:3e:d5:ed:2c", "network": {"id": "a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972", "bridge": "br-int", "label": "tempest-TestVolumeSwap-715659165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dfe057a9f742ceb908883f28463a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932d0b4b-da", "ovs_interfaceid": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Converting VIF {"id": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "address": "fa:16:3e:d5:ed:2c", "network": {"id": "a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972", "bridge": "br-int", "label": "tempest-TestVolumeSwap-715659165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dfe057a9f742ceb908883f28463a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932d0b4b-da", "ovs_interfaceid": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:ed:2c,bridge_name='br-int',has_traffic_filtering=True,id=932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3,network=Network(a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932d0b4b-da') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG os_vif [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:ed:2c,bridge_name='br-int',has_traffic_filtering=True,id=932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3,network=Network(a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932d0b4b-da') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap932d0b4b-da, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap932d0b4b-da, col_values=(('external_ids', {'iface-id': '932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:ed:2c', 'vm-uuid': '990b083b-744a-42cb-88f3-7ae16a5abed4'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:07 user nova-compute[72019]: INFO os_vif [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:ed:2c,bridge_name='br-int',has_traffic_filtering=True,id=932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3,network=Network(a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932d0b4b-da')
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Updating instance_info_cache with network_info: [{"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] No VIF found with MAC fa:16:3e:d5:ed:2c, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Releasing lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Instance network_info: |[{"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] Acquired lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.network.neutron [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Refreshing network info cache for port 0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Start _get_guest_xml network_info=[{"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:13:07 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:07 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1305382448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1305382448',id=10,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4duIqCv7vEVSja8IqrS2m8nOyBfEtm9GNp6oVWYmKH8ODAqPLRXepqVchMI9s9qHWy17HwfyhVBB5y+o51mGHAALloM+mnGYFQ/OSrPtSKKkLrtAKZzJf5wagS5jGc7w==',key_name='tempest-keypair-1468650109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3a7e094618456381891d4532bb3cf2',ramdisk_id='',reservation_id='r-34cd3eyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-246329900',owner_user_name='tempest-TaggedAttachmentsTest-246329900-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016ee10024d2449c93d67e0b14f09f95',uuid=15df44a4-fc31-4dfa-870d-0dd1db47ccd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Converting VIF {"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:46:60,bridge_name='br-int',has_traffic_filtering=True,id=0946e034-1e6c-42d6-a8e2-1b24fabc000c,network=Network(53eda3e7-82e5-4c42-81d1-a180eb205a2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0946e034-1e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lazy-loading 'pci_devices' on Instance uuid 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:13:07 user nova-compute[72019]:   <uuid>15df44a4-fc31-4dfa-870d-0dd1db47ccd7</uuid>
Apr 14 13:13:07 user nova-compute[72019]:   <name>instance-0000000a</name>
Apr 14 13:13:07 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:13:07 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:13:07 user nova-compute[72019]:   <metadata>
Apr 14 13:13:07 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:13:07 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:13:07 user nova-compute[72019]:       <nova:name>tempest-device-tagging-server-1305382448</nova:name>
Apr 14 13:13:07 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:13:07</nova:creationTime>
Apr 14 13:13:07 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:13:07 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:13:07 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:13:07 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:13:07 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:13:07 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:13:07 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:13:07 user nova-compute[72019]:       <nova:owner>
Apr 14 13:13:07 user nova-compute[72019]:         <nova:user uuid="016ee10024d2449c93d67e0b14f09f95">tempest-TaggedAttachmentsTest-246329900-project-member</nova:user>
Apr 14 13:13:07 user nova-compute[72019]:         <nova:project uuid="ab3a7e094618456381891d4532bb3cf2">tempest-TaggedAttachmentsTest-246329900</nova:project>
Apr 14 13:13:07 user nova-compute[72019]:       </nova:owner>
Apr 14 13:13:07 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:13:07 user nova-compute[72019]:       <nova:ports>
Apr 14 13:13:07 user nova-compute[72019]:         <nova:port uuid="0946e034-1e6c-42d6-a8e2-1b24fabc000c">
Apr 14 13:13:07 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 13:13:07 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:07 user nova-compute[72019]:       </nova:ports>
Apr 14 13:13:07 user nova-compute[72019]:     </nova:instance>
Apr 14 13:13:07 user nova-compute[72019]:   </metadata>
Apr 14 13:13:07 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:13:07 user nova-compute[72019]:     <system>
Apr 14 13:13:07 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:13:07 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:13:07 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:13:07 user nova-compute[72019]:       <entry name="serial">15df44a4-fc31-4dfa-870d-0dd1db47ccd7</entry>
Apr 14 13:13:07 user nova-compute[72019]:       <entry name="uuid">15df44a4-fc31-4dfa-870d-0dd1db47ccd7</entry>
Apr 14 13:13:07 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:13:07 user nova-compute[72019]:     </system>
Apr 14 13:13:07 user nova-compute[72019]:   </sysinfo>
Apr 14 13:13:07 user nova-compute[72019]:   <os>
Apr 14 13:13:07 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:13:07 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:13:07 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:13:07 user nova-compute[72019]:   </os>
Apr 14 13:13:07 user nova-compute[72019]:   <features>
Apr 14 13:13:07 user nova-compute[72019]:     <acpi/>
Apr 14 13:13:07 user nova-compute[72019]:     <apic/>
Apr 14 13:13:07 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:13:07 user nova-compute[72019]:   </features>
Apr 14 13:13:07 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:13:07 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:13:07 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:13:07 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:13:07 user nova-compute[72019]:   </clock>
Apr 14 13:13:07 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:13:07 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:13:07 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:13:07 user nova-compute[72019]:   </cpu>
Apr 14 13:13:07 user nova-compute[72019]:   <devices>
Apr 14 13:13:07 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:13:07 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:13:07 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk"/>
Apr 14 13:13:07 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:13:07 user nova-compute[72019]:     </disk>
Apr 14 13:13:07 user nova-compute[72019]:     <disk type="file" device="cdrom">
Apr 14 13:13:07 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 13:13:07 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk.config"/>
Apr 14 13:13:07 user nova-compute[72019]:       <target dev="hda" bus="ide"/>
Apr 14 13:13:07 user nova-compute[72019]:     </disk>
Apr 14 13:13:07 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:07 user nova-compute[72019]:       <mac address="fa:16:3e:e8:46:60"/>
Apr 14 13:13:07 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:07 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:07 user nova-compute[72019]:       <target dev="tap0946e034-1e"/>
Apr 14 13:13:07 user nova-compute[72019]:     </interface>
Apr 14 13:13:07 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:13:07 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/console.log" append="off"/>
Apr 14 13:13:07 user nova-compute[72019]:     </serial>
Apr 14 13:13:07 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:13:07 user nova-compute[72019]:     <video>
Apr 14 13:13:07 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:07 user nova-compute[72019]:     </video>
Apr 14 13:13:07 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:13:07 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:13:07 user nova-compute[72019]:     </rng>
Apr 14 13:13:07 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:13:07 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:13:07 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:13:07 user nova-compute[72019]:     </memballoon>
Apr 14 13:13:07 user nova-compute[72019]:   </devices>
Apr 14 13:13:07 user nova-compute[72019]: </domain>
Apr 14 13:13:07 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1305382448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1305382448',id=10,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4duIqCv7vEVSja8IqrS2m8nOyBfEtm9GNp6oVWYmKH8ODAqPLRXepqVchMI9s9qHWy17HwfyhVBB5y+o51mGHAALloM+mnGYFQ/OSrPtSKKkLrtAKZzJf5wagS5jGc7w==',key_name='tempest-keypair-1468650109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab3a7e094618456381891d4532bb3cf2',ramdisk_id='',reservation_id='r-34cd3eyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-246329900',owner_user_name='tempest-TaggedAttachmentsTest-246329900-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016ee10024d2449c93d67e0b14f09f95',uuid=15df44a4-fc31-4dfa-870d-0dd1db47ccd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Converting VIF {"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:46:60,bridge_name='br-int',has_traffic_filtering=True,id=0946e034-1e6c-42d6-a8e2-1b24fabc000c,network=Network(53eda3e7-82e5-4c42-81d1-a180eb205a2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0946e034-1e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG os_vif [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:46:60,bridge_name='br-int',has_traffic_filtering=True,id=0946e034-1e6c-42d6-a8e2-1b24fabc000c,network=Network(53eda3e7-82e5-4c42-81d1-a180eb205a2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0946e034-1e') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0946e034-1e, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0946e034-1e, col_values=(('external_ids', {'iface-id': '0946e034-1e6c-42d6-a8e2-1b24fabc000c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:46:60', 'vm-uuid': '15df44a4-fc31-4dfa-870d-0dd1db47ccd7'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:07 user nova-compute[72019]: INFO os_vif [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:46:60,bridge_name='br-int',has_traffic_filtering=True,id=0946e034-1e6c-42d6-a8e2-1b24fabc000c,network=Network(53eda3e7-82e5-4c42-81d1-a180eb205a2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0946e034-1e')
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] No BDM found with device name hda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:13:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] No VIF found with MAC fa:16:3e:e8:46:60, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:13:07 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Using config drive
Apr 14 13:13:07 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Creating config drive at /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk.config
Apr 14 13:13:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbezbbmi6 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Received event network-vif-plugged-fe327006-c497-4b3f-8e4a-74a407193cb4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] Acquiring lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] Lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] Lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] No waiting events found dispatching network-vif-plugged-fe327006-c497-4b3f-8e4a-74a407193cb4 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:08 user nova-compute[72019]: WARNING nova.compute.manager [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Received unexpected event network-vif-plugged-fe327006-c497-4b3f-8e4a-74a407193cb4 for instance with vm_state building and task_state spawning.
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Received event network-vif-plugged-fe327006-c497-4b3f-8e4a-74a407193cb4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] Acquiring lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] Lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] Lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] No waiting events found dispatching network-vif-plugged-fe327006-c497-4b3f-8e4a-74a407193cb4 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:08 user nova-compute[72019]: WARNING nova.compute.manager [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Received unexpected event network-vif-plugged-fe327006-c497-4b3f-8e4a-74a407193cb4 for instance with vm_state building and task_state spawning.
Apr 14 13:13:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbezbbmi6" returned: 0 in 0.100s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.network.neutron [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Updated VIF entry in instance network info cache for port 0946e034-1e6c-42d6-a8e2-1b24fabc000c. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.network.neutron [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Updating instance_info_cache with network_info: [{"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477988.1282785, f9b4e51c-b24a-4025-8be1-4294d06c18ff => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:08 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] VM Resumed (Lifecycle Event)
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:13:08 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Instance spawned successfully.
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] Releasing lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:08 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477988.1361837, f9b4e51c-b24a-4025-8be1-4294d06c18ff => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:08 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] VM Started (Lifecycle Event)
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:08 user nova-compute[72019]: INFO nova.compute.manager [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Took 11.49 seconds to spawn the instance on the hypervisor.
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:08 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.network.neutron [req-3b49996e-d296-4f24-b9b9-95d34e89cf19 req-ddc7671b-85d2-4266-a60a-7102b1822c79 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Updated VIF entry in instance network info cache for port 932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.network.neutron [req-3b49996e-d296-4f24-b9b9-95d34e89cf19 req-ddc7671b-85d2-4266-a60a-7102b1822c79 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Updating instance_info_cache with network_info: [{"id": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "address": "fa:16:3e:d5:ed:2c", "network": {"id": "a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972", "bridge": "br-int", "label": "tempest-TestVolumeSwap-715659165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dfe057a9f742ceb908883f28463a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932d0b4b-da", "ovs_interfaceid": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:08 user nova-compute[72019]: INFO nova.compute.manager [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Took 13.24 seconds to build instance.
Apr 14 13:13:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.478s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3b49996e-d296-4f24-b9b9-95d34e89cf19 req-ddc7671b-85d2-4266-a60a-7102b1822c79 service nova] Releasing lock "refresh_cache-990b083b-744a-42cb-88f3-7ae16a5abed4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477988.628984, e058f6b1-e83b-49af-9ab3-a29b959f211f => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:08 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] VM Resumed (Lifecycle Event)
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:08 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Instance spawned successfully.
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:08 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477988.6336725, e058f6b1-e83b-49af-9ab3-a29b959f211f => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:08 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] VM Started (Lifecycle Event)
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:08 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:08 user nova-compute[72019]: INFO nova.compute.manager [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Took 10.41 seconds to spawn the instance on the hypervisor.
Apr 14 13:13:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:09 user nova-compute[72019]: INFO nova.compute.manager [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Took 12.71 seconds to build instance.
Apr 14 13:13:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "e058f6b1-e83b-49af-9ab3-a29b959f211f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.958s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-b8854563-18d4-4a31-b2ad-18abe2db9544 req-cc7e0ab8-3609-424c-b374-77d6915e0cf5 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Received event network-vif-plugged-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b8854563-18d4-4a31-b2ad-18abe2db9544 req-cc7e0ab8-3609-424c-b374-77d6915e0cf5 service nova] Acquiring lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b8854563-18d4-4a31-b2ad-18abe2db9544 req-cc7e0ab8-3609-424c-b374-77d6915e0cf5 service nova] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b8854563-18d4-4a31-b2ad-18abe2db9544 req-cc7e0ab8-3609-424c-b374-77d6915e0cf5 service nova] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-b8854563-18d4-4a31-b2ad-18abe2db9544 req-cc7e0ab8-3609-424c-b374-77d6915e0cf5 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] No waiting events found dispatching network-vif-plugged-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:10 user nova-compute[72019]: WARNING nova.compute.manager [req-b8854563-18d4-4a31-b2ad-18abe2db9544 req-cc7e0ab8-3609-424c-b374-77d6915e0cf5 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Received unexpected event network-vif-plugged-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 for instance with vm_state building and task_state spawning.
Apr 14 13:13:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-9be26ea8-5a54-4295-9a1c-a92f681a31e5 req-9008a7d8-28ea-4c26-8eb9-af8d5ff2c9a0 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received event network-vif-plugged-0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9be26ea8-5a54-4295-9a1c-a92f681a31e5 req-9008a7d8-28ea-4c26-8eb9-af8d5ff2c9a0 service nova] Acquiring lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9be26ea8-5a54-4295-9a1c-a92f681a31e5 req-9008a7d8-28ea-4c26-8eb9-af8d5ff2c9a0 service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9be26ea8-5a54-4295-9a1c-a92f681a31e5 req-9008a7d8-28ea-4c26-8eb9-af8d5ff2c9a0 service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-9be26ea8-5a54-4295-9a1c-a92f681a31e5 req-9008a7d8-28ea-4c26-8eb9-af8d5ff2c9a0 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] No waiting events found dispatching network-vif-plugged-0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:10 user nova-compute[72019]: WARNING nova.compute.manager [req-9be26ea8-5a54-4295-9a1c-a92f681a31e5 req-9008a7d8-28ea-4c26-8eb9-af8d5ff2c9a0 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received unexpected event network-vif-plugged-0946e034-1e6c-42d6-a8e2-1b24fabc000c for instance with vm_state building and task_state spawning.
Apr 14 13:13:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:11 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:13:11 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Cleaning up deleted instances {{(pid=72019) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 13:13:11 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] There are 0 instances to clean {{(pid=72019) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 13:13:11 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:13:11 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72019) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 13:13:11 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:13:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-49bc3663-e9ae-4919-bd68-5ed1b362ac5c req-bf4b3cc3-d328-46d9-a8bb-27e990cd43eb service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Received event network-vif-plugged-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-49bc3663-e9ae-4919-bd68-5ed1b362ac5c req-bf4b3cc3-d328-46d9-a8bb-27e990cd43eb service nova] Acquiring lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-49bc3663-e9ae-4919-bd68-5ed1b362ac5c req-bf4b3cc3-d328-46d9-a8bb-27e990cd43eb service nova] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-49bc3663-e9ae-4919-bd68-5ed1b362ac5c req-bf4b3cc3-d328-46d9-a8bb-27e990cd43eb service nova] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-49bc3663-e9ae-4919-bd68-5ed1b362ac5c req-bf4b3cc3-d328-46d9-a8bb-27e990cd43eb service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] No waiting events found dispatching network-vif-plugged-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:12 user nova-compute[72019]: WARNING nova.compute.manager [req-49bc3663-e9ae-4919-bd68-5ed1b362ac5c req-bf4b3cc3-d328-46d9-a8bb-27e990cd43eb service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Received unexpected event network-vif-plugged-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 for instance with vm_state building and task_state spawning.
Apr 14 13:13:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-6d5d87ea-649e-46b9-8c07-80d22ffdd1fc req-aba6acdf-fbaa-430a-9012-4e094d2d1af9 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received event network-vif-plugged-0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6d5d87ea-649e-46b9-8c07-80d22ffdd1fc req-aba6acdf-fbaa-430a-9012-4e094d2d1af9 service nova] Acquiring lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6d5d87ea-649e-46b9-8c07-80d22ffdd1fc req-aba6acdf-fbaa-430a-9012-4e094d2d1af9 service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6d5d87ea-649e-46b9-8c07-80d22ffdd1fc req-aba6acdf-fbaa-430a-9012-4e094d2d1af9 service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-6d5d87ea-649e-46b9-8c07-80d22ffdd1fc req-aba6acdf-fbaa-430a-9012-4e094d2d1af9 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] No waiting events found dispatching network-vif-plugged-0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:12 user nova-compute[72019]: WARNING nova.compute.manager [req-6d5d87ea-649e-46b9-8c07-80d22ffdd1fc req-aba6acdf-fbaa-430a-9012-4e094d2d1af9 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received unexpected event network-vif-plugged-0946e034-1e6c-42d6-a8e2-1b24fabc000c for instance with vm_state building and task_state spawning.
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477993.395419, 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] VM Resumed (Lifecycle Event)
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:13:13 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Instance spawned successfully.
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:13:13 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Instance spawned successfully.
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477993.3973212, 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] VM Started (Lifecycle Event)
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477993.397442, 990b083b-744a-42cb-88f3-7ae16a5abed4 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] VM Resumed (Lifecycle Event)
Apr 14 13:13:13 user nova-compute[72019]: INFO nova.compute.manager [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Took 14.10 seconds to spawn the instance on the hypervisor.
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:13 user nova-compute[72019]: INFO nova.compute.manager [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Took 9.71 seconds to spawn the instance on the hypervisor.
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681477993.3996434, 990b083b-744a-42cb-88f3-7ae16a5abed4 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] VM Started (Lifecycle Event)
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:13 user nova-compute[72019]: INFO nova.compute.manager [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Took 17.25 seconds to build instance.
Apr 14 13:13:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.415s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:13 user nova-compute[72019]: INFO nova.compute.manager [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Took 10.91 seconds to build instance.
Apr 14 13:13:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.067s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:14 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:13:14 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:13:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:13:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Rebuilding the list of instances to heal {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 13:13:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-62e10eb2-a042-4916-8b61-51f7dcd731dd" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-62e10eb2-a042-4916-8b61-51f7dcd731dd" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:14 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:13:14 user nova-compute[72019]: DEBUG nova.objects.instance [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lazy-loading 'info_cache' on Instance uuid 62e10eb2-a042-4916-8b61-51f7dcd731dd {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:13:15 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Updating instance_info_cache with network_info: [{"id": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "address": "fa:16:3e:2d:13:e0", "network": {"id": "69762a08-01c9-4ee5-9118-3824b54739c4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721534193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d534e4c1cd4abb9204ce53e9a2a7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2255403b-5b", "ovs_interfaceid": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-62e10eb2-a042-4916-8b61-51f7dcd731dd" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:15 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:13:15 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:13:15 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:13:15 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:13:15 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:13:15 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:13:15 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:13:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:16 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:13:16 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:13:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:16 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:13:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:13:19 user nova-compute[72019]: INFO nova.compute.claims [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Claim successful on node user
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:20 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:13:20 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:13:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.745s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:13:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:13:20 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:13:20 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:13:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.policy [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7115dcde1a6480e9e2db9cb8d4fdad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b68596374d4b918a83f403f2f25143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:13:21 user nova-compute[72019]: INFO nova.virt.block_device [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Booting with volume 6f1c3902-8299-4b2d-814c-3848a40fdb21 at /dev/vda
Apr 14 13:13:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:21 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:21 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7640MB free_disk=26.60614013671875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG os_brick.utils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:13:21 user nova-compute[72019]: INFO oslo.privsep.daemon [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmplap3xb8q/privsep.sock']
Apr 14 13:13:21 user sudo[82357]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmplap3xb8q/privsep.sock
Apr 14 13:13:21 user sudo[82357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 13:13:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 990b083b-744a-42cb-88f3-7ae16a5abed4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance c74c3463-6701-4150-9096-1775785e8e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance e058f6b1-e83b-49af-9ab3-a29b959f211f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing inventories for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Updating ProviderTree inventory for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Updating inventory in ProviderTree for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 13:13:21 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing aggregate associations for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569, aggregates: None {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 13:13:22 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Successfully created port: 97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:13:22 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing trait associations for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 13:13:22 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:13:22 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:13:22 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:13:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.237s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.889s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:13:22 user nova-compute[72019]: INFO nova.compute.claims [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Claim successful on node user
Apr 14 13:13:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:22 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Successfully created port: 96beb287-2181-4df4-b835-a9f071ace5df {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG nova.compute.manager [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG nova.compute.manager [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:13:23 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:13:23 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Successfully created port: 8a4f2864-33fc-4666-bb51-bdd01bc07af4 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG nova.compute.manager [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:13:23 user sudo[82357]: pam_unix(sudo:session): session closed for user root
Apr 14 13:13:23 user nova-compute[72019]: INFO oslo.privsep.daemon [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Spawned new privsep daemon via rootwrap
Apr 14 13:13:23 user nova-compute[72019]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 13:13:23 user nova-compute[72019]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 13:13:23 user nova-compute[72019]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 14 13:13:23 user nova-compute[72019]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82397
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dbb495-cf5f-4d6c-b4c1-8d214c1c74ee]: (2,) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:23 user nova-compute[72019]: INFO nova.virt.block_device [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Booting with volume 2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 at /dev/vda
Apr 14 13:13:23 user nova-compute[72019]: DEBUG nova.policy [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '213b7b010b7f40b0946ec1575216e80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16235c48e6fb4457bbd7edfa321929a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG os_brick.utils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf9c734-86d3-42fc-bc2a-03463de53310]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:23 user nova-compute[72019]: WARNING os_brick.initiator.connectors.nvmeof [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[305a1cd1-249b-4ed2-976d-8cb0ac9995b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[319c9e8a-a167-42fc-92fa-74b34b72a5bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[85039a47-c4d4-4e07-9eee-967ee60efc1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb1f987-0a7e-4f35-abd8-fccf9cfc038c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b31c67-debf-4fbb-a68e-4c06bb14d5b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5aa753-9d34-4a8b-8686-46d66122741c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5896e9-cb80-419e-aaec-c35e8b23bfb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:13:23 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87129fb-9fde-4379-9ae9-4618a737788c]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG os_brick.utils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] <== get_connector_properties: return (2421ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating existing volume attachment record: 23a52692-01ea-4d92-b4ca-0f46e7c2c93c {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:13:23 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:13:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e403c1b9-e2a5-4a0e-99f5-fce73bb36aba]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG os_brick.utils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] <== get_connector_properties: return (210ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:13:23 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating existing volume attachment record: a84eef5f-ead4-4da3-afea-43fe98d33614 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:13:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Successfully created port: 4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:13:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Successfully created port: c2904a0c-904d-4dc3-9ffc-aaa05e253319 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:13:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Successfully created port: 1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:13:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Successfully created port: 3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:13:25 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Successfully created port: 64455602-0478-47d7-9d50-551d552ceb26 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:13:25 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Successfully updated port: 97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-7c077004-b924-41d1-94c3-1da6e1ba837b req-927dc2fe-7ca7-45fd-9d4c-c775b5c24fb2 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-changed-97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-7c077004-b924-41d1-94c3-1da6e1ba837b req-927dc2fe-7ca7-45fd-9d4c-c775b5c24fb2 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing instance network info cache due to event network-changed-97d7d320-4ac2-41af-86ca-c30f00808f33. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c077004-b924-41d1-94c3-1da6e1ba837b req-927dc2fe-7ca7-45fd-9d4c-c775b5c24fb2 service nova] Acquiring lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c077004-b924-41d1-94c3-1da6e1ba837b req-927dc2fe-7ca7-45fd-9d4c-c775b5c24fb2 service nova] Acquired lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:25 user nova-compute[72019]: DEBUG nova.network.neutron [req-7c077004-b924-41d1-94c3-1da6e1ba837b req-927dc2fe-7ca7-45fd-9d4c-c775b5c24fb2 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing network info cache for port 97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:25 user nova-compute[72019]: DEBUG nova.network.neutron [req-7c077004-b924-41d1-94c3-1da6e1ba837b req-927dc2fe-7ca7-45fd-9d4c-c775b5c24fb2 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:26 user nova-compute[72019]: DEBUG nova.network.neutron [req-7c077004-b924-41d1-94c3-1da6e1ba837b req-927dc2fe-7ca7-45fd-9d4c-c775b5c24fb2 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c077004-b924-41d1-94c3-1da6e1ba837b req-927dc2fe-7ca7-45fd-9d4c-c775b5c24fb2 service nova] Releasing lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:26 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Successfully updated port: ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:26 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Successfully created port: ff64a492-8e97-4c11-9207-bf56011d8a5d {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:13:27 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Successfully updated port: 089a686b-763d-41df-b624-291933367593 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:27 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Successfully created port: 8e63fe4d-bc87-40cb-855e-ad82726ca39d {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:13:27 user nova-compute[72019]: DEBUG nova.compute.manager [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-changed-ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:27 user nova-compute[72019]: DEBUG nova.compute.manager [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing instance network info cache due to event network-changed-ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] Acquiring lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] Acquired lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:27 user nova-compute[72019]: DEBUG nova.network.neutron [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing network info cache for port ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:27 user nova-compute[72019]: DEBUG nova.network.neutron [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Successfully updated port: 96beb287-2181-4df4-b835-a9f071ace5df {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG nova.network.neutron [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] Releasing lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-changed-089a686b-763d-41df-b624-291933367593 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing instance network info cache due to event network-changed-089a686b-763d-41df-b624-291933367593. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] Acquiring lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] Acquired lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG nova.network.neutron [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing network info cache for port 089a686b-763d-41df-b624-291933367593 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG nova.network.neutron [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Successfully updated port: 4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-46b1b14d-f058-4b06-97e3-acb9d7f4a913 req-9e2d17ab-daa8-419a-ba9c-364c2460f8eb service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-changed-4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-46b1b14d-f058-4b06-97e3-acb9d7f4a913 req-9e2d17ab-daa8-419a-ba9c-364c2460f8eb service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing instance network info cache due to event network-changed-4fef6c1f-75be-46b1-b091-f3717d65bb21. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46b1b14d-f058-4b06-97e3-acb9d7f4a913 req-9e2d17ab-daa8-419a-ba9c-364c2460f8eb service nova] Acquiring lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46b1b14d-f058-4b06-97e3-acb9d7f4a913 req-9e2d17ab-daa8-419a-ba9c-364c2460f8eb service nova] Acquired lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG nova.network.neutron [req-46b1b14d-f058-4b06-97e3-acb9d7f4a913 req-9e2d17ab-daa8-419a-ba9c-364c2460f8eb service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing network info cache for port 4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG nova.network.neutron [req-46b1b14d-f058-4b06-97e3-acb9d7f4a913 req-9e2d17ab-daa8-419a-ba9c-364c2460f8eb service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG nova.network.neutron [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] Releasing lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:28 user nova-compute[72019]: DEBUG nova.network.neutron [req-46b1b14d-f058-4b06-97e3-acb9d7f4a913 req-9e2d17ab-daa8-419a-ba9c-364c2460f8eb service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46b1b14d-f058-4b06-97e3-acb9d7f4a913 req-9e2d17ab-daa8-419a-ba9c-364c2460f8eb service nova] Releasing lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:29 user nova-compute[72019]: INFO nova.virt.block_device [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Booting with volume cfbc1718-f375-48f6-b94c-63ac9c4807a6 at /dev/vdb
Apr 14 13:13:29 user nova-compute[72019]: DEBUG os_brick.utils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[62377a79-36a6-477d-893b-5f17abc874a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb2148a-39d6-4715-98f2-e27409db3094]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Successfully updated port: 8a4f2864-33fc-4666-bb51-bdd01bc07af4 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9fa820-29c4-450f-b8ae-2252f9fdce59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3f9e5e-8138-485d-ab03-952b9f72123a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-40ec0d7b-b807-49ca-aa89-c0f7b7a699cf req-40a34945-b531-41e3-8efb-026e084d0312 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-changed-8a4f2864-33fc-4666-bb51-bdd01bc07af4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-40ec0d7b-b807-49ca-aa89-c0f7b7a699cf req-40a34945-b531-41e3-8efb-026e084d0312 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing instance network info cache due to event network-changed-8a4f2864-33fc-4666-bb51-bdd01bc07af4. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-40ec0d7b-b807-49ca-aa89-c0f7b7a699cf req-40a34945-b531-41e3-8efb-026e084d0312 service nova] Acquiring lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-40ec0d7b-b807-49ca-aa89-c0f7b7a699cf req-40a34945-b531-41e3-8efb-026e084d0312 service nova] Acquired lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG nova.network.neutron [req-40ec0d7b-b807-49ca-aa89-c0f7b7a699cf req-40a34945-b531-41e3-8efb-026e084d0312 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing network info cache for port 8a4f2864-33fc-4666-bb51-bdd01bc07af4 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:29 user nova-compute[72019]: INFO nova.virt.block_device [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Booting with volume 09520b36-0291-4949-b4bd-5ef9452f1160 at /dev/vdb
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:13:29 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[715aa7a0-b867-4a2f-9c4c-f9aa41d3e6e7]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG os_brick.utils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating existing volume attachment record: 5f87d902-785a-4cb6-8bf3-349b6246de5a {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG os_brick.utils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d42005-e75e-4c6b-b9f0-1fa0cd48d34c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG nova.network.neutron [req-40ec0d7b-b807-49ca-aa89-c0f7b7a699cf req-40a34945-b531-41e3-8efb-026e084d0312 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cd4a05-c517-4039-b782-08b4400cb21f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bcbbcd-6e0d-4d30-928e-5bc4353f007e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d06552-f57c-4b8d-8387-eb6cf533ec0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:13:29 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[98383475-9fa9-473e-aeae-7ca3dae24779]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG os_brick.utils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating existing volume attachment record: 87ce1bdc-6eef-4467-a65f-269cab9ce2fe {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Successfully updated port: 3532d3d6-73ac-40eb-9486-d70fac78c992 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-5f48c287-e534-443a-b945-c7908bd21352 req-16d8e85b-a82e-4a7a-9c13-d9781f2af174 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-changed-96beb287-2181-4df4-b835-a9f071ace5df {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-5f48c287-e534-443a-b945-c7908bd21352 req-16d8e85b-a82e-4a7a-9c13-d9781f2af174 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing instance network info cache due to event network-changed-96beb287-2181-4df4-b835-a9f071ace5df. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5f48c287-e534-443a-b945-c7908bd21352 req-16d8e85b-a82e-4a7a-9c13-d9781f2af174 service nova] Acquiring lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG nova.network.neutron [req-40ec0d7b-b807-49ca-aa89-c0f7b7a699cf req-40a34945-b531-41e3-8efb-026e084d0312 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-40ec0d7b-b807-49ca-aa89-c0f7b7a699cf req-40a34945-b531-41e3-8efb-026e084d0312 service nova] Releasing lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5f48c287-e534-443a-b945-c7908bd21352 req-16d8e85b-a82e-4a7a-9c13-d9781f2af174 service nova] Acquired lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:29 user nova-compute[72019]: DEBUG nova.network.neutron [req-5f48c287-e534-443a-b945-c7908bd21352 req-16d8e85b-a82e-4a7a-9c13-d9781f2af174 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing network info cache for port 96beb287-2181-4df4-b835-a9f071ace5df {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:30 user nova-compute[72019]: DEBUG nova.network.neutron [req-5f48c287-e534-443a-b945-c7908bd21352 req-16d8e85b-a82e-4a7a-9c13-d9781f2af174 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:30 user nova-compute[72019]: DEBUG nova.network.neutron [req-5f48c287-e534-443a-b945-c7908bd21352 req-16d8e85b-a82e-4a7a-9c13-d9781f2af174 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5f48c287-e534-443a-b945-c7908bd21352 req-16d8e85b-a82e-4a7a-9c13-d9781f2af174 service nova] Releasing lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:30 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Successfully updated port: 3929e20e-3bcb-4e87-bbb3-59f52e6e7047 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-55afe272-0eb2-48af-97eb-07ba02c16597 req-45acd721-7d1e-48c7-8d99-a734fa8c4716 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-changed-3532d3d6-73ac-40eb-9486-d70fac78c992 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-55afe272-0eb2-48af-97eb-07ba02c16597 req-45acd721-7d1e-48c7-8d99-a734fa8c4716 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing instance network info cache due to event network-changed-3532d3d6-73ac-40eb-9486-d70fac78c992. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-55afe272-0eb2-48af-97eb-07ba02c16597 req-45acd721-7d1e-48c7-8d99-a734fa8c4716 service nova] Acquiring lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-55afe272-0eb2-48af-97eb-07ba02c16597 req-45acd721-7d1e-48c7-8d99-a734fa8c4716 service nova] Acquired lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:30 user nova-compute[72019]: DEBUG nova.network.neutron [req-55afe272-0eb2-48af-97eb-07ba02c16597 req-45acd721-7d1e-48c7-8d99-a734fa8c4716 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing network info cache for port 3532d3d6-73ac-40eb-9486-d70fac78c992 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:30 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Successfully updated port: c2904a0c-904d-4dc3-9ffc-aaa05e253319 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:30 user nova-compute[72019]: DEBUG nova.network.neutron [req-55afe272-0eb2-48af-97eb-07ba02c16597 req-45acd721-7d1e-48c7-8d99-a734fa8c4716 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:30 user nova-compute[72019]: DEBUG nova.network.neutron [req-55afe272-0eb2-48af-97eb-07ba02c16597 req-45acd721-7d1e-48c7-8d99-a734fa8c4716 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-55afe272-0eb2-48af-97eb-07ba02c16597 req-45acd721-7d1e-48c7-8d99-a734fa8c4716 service nova] Releasing lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:31 user nova-compute[72019]: DEBUG nova.compute.manager [req-8b3e0e0e-4b96-4b10-8858-be2d1e307107 req-7c7ef1ec-4ad9-4ba4-b23f-a7cc6a5ff679 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-changed-c2904a0c-904d-4dc3-9ffc-aaa05e253319 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:31 user nova-compute[72019]: DEBUG nova.compute.manager [req-8b3e0e0e-4b96-4b10-8858-be2d1e307107 req-7c7ef1ec-4ad9-4ba4-b23f-a7cc6a5ff679 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing instance network info cache due to event network-changed-c2904a0c-904d-4dc3-9ffc-aaa05e253319. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8b3e0e0e-4b96-4b10-8858-be2d1e307107 req-7c7ef1ec-4ad9-4ba4-b23f-a7cc6a5ff679 service nova] Acquiring lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8b3e0e0e-4b96-4b10-8858-be2d1e307107 req-7c7ef1ec-4ad9-4ba4-b23f-a7cc6a5ff679 service nova] Acquired lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:31 user nova-compute[72019]: DEBUG nova.network.neutron [req-8b3e0e0e-4b96-4b10-8858-be2d1e307107 req-7c7ef1ec-4ad9-4ba4-b23f-a7cc6a5ff679 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing network info cache for port c2904a0c-904d-4dc3-9ffc-aaa05e253319 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:31 user nova-compute[72019]: DEBUG nova.network.neutron [req-8b3e0e0e-4b96-4b10-8858-be2d1e307107 req-7c7ef1ec-4ad9-4ba4-b23f-a7cc6a5ff679 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:31 user nova-compute[72019]: DEBUG nova.network.neutron [req-8b3e0e0e-4b96-4b10-8858-be2d1e307107 req-7c7ef1ec-4ad9-4ba4-b23f-a7cc6a5ff679 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8b3e0e0e-4b96-4b10-8858-be2d1e307107 req-7c7ef1ec-4ad9-4ba4-b23f-a7cc6a5ff679 service nova] Releasing lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:31 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Successfully updated port: 3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:32 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Successfully updated port: 1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquired lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:32 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:13:32 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-19268a90-9f25-4ca0-a40d-f7578368f4fc req-c69f19be-e2e7-432f-b858-94e06806f206 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-changed-3929e20e-3bcb-4e87-bbb3-59f52e6e7047 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-19268a90-9f25-4ca0-a40d-f7578368f4fc req-c69f19be-e2e7-432f-b858-94e06806f206 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing instance network info cache due to event network-changed-3929e20e-3bcb-4e87-bbb3-59f52e6e7047. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19268a90-9f25-4ca0-a40d-f7578368f4fc req-c69f19be-e2e7-432f-b858-94e06806f206 service nova] Acquiring lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19268a90-9f25-4ca0-a40d-f7578368f4fc req-c69f19be-e2e7-432f-b858-94e06806f206 service nova] Acquired lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:32 user nova-compute[72019]: DEBUG nova.network.neutron [req-19268a90-9f25-4ca0-a40d-f7578368f4fc req-c69f19be-e2e7-432f-b858-94e06806f206 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing network info cache for port 3929e20e-3bcb-4e87-bbb3-59f52e6e7047 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:32 user nova-compute[72019]: DEBUG nova.network.neutron [req-19268a90-9f25-4ca0-a40d-f7578368f4fc req-c69f19be-e2e7-432f-b858-94e06806f206 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:33 user nova-compute[72019]: DEBUG nova.network.neutron [req-19268a90-9f25-4ca0-a40d-f7578368f4fc req-c69f19be-e2e7-432f-b858-94e06806f206 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19268a90-9f25-4ca0-a40d-f7578368f4fc req-c69f19be-e2e7-432f-b858-94e06806f206 service nova] Releasing lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-changed-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing instance network info cache due to event network-changed-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] Acquiring lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] Acquired lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:33 user nova-compute[72019]: DEBUG nova.network.neutron [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing network info cache for port 3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:33 user nova-compute[72019]: DEBUG nova.network.neutron [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:33 user nova-compute[72019]: DEBUG nova.network.neutron [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] Releasing lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-changed-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing instance network info cache due to event network-changed-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] Acquiring lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:33 user nova-compute[72019]: INFO nova.virt.block_device [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Booting with volume 24475c44-054d-436f-b2f8-17918c27ccc1 at /dev/vdc
Apr 14 13:13:33 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Successfully updated port: 64455602-0478-47d7-9d50-551d552ceb26 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG os_brick.utils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f5eb85-72fc-4aec-825f-4800c22e77dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[776c3f28-4a17-42c8-83bd-849fbe070ea2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[984d3fe3-6a46-4182-bb96-3383531393e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a5f124-0f54-49c4-a657-2be74ad091ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:13:34 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfee251e-4c64-468a-9c3a-4f98c9dc8e05]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG os_brick.utils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating existing volume attachment record: b1c9a584-9052-443f-aa8c-fa2621e53ad2 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:13:34 user nova-compute[72019]: INFO nova.compute.claims [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Claim successful on node user
Apr 14 13:13:34 user nova-compute[72019]: INFO nova.virt.block_device [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Booting with volume f0db7698-a216-42b4-a592-80a4cb5568bc at /dev/vdc
Apr 14 13:13:34 user nova-compute[72019]: DEBUG os_brick.utils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[36790713-53c5-4aaf-a218-2c159fed70d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[75178d6d-07f1-48af-a4a2-ac16c27bf020]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f6907f-ef06-44ab-8c3c-5543a0db5b20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[33335695-1029-40b4-ad50-c70464a9b5d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:13:34 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32014d8-d993-42dc-9965-af7b9904b491]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG os_brick.utils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating existing volume attachment record: 722041f8-25ac-4f0e-beb0-9bf820bd8bcf {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:13:34 user nova-compute[72019]: DEBUG nova.network.neutron [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:13:34 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:13:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG nova.policy [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f3445d14b0a44fd999bc2fc875c77bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe64d1d65224162b60849eace352cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:13:35 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Creating image(s)
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "/opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "/opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "/opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.176s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG nova.compute.manager [req-1763eeef-0167-404b-9ee1-98dc6cc51705 req-bb16a03e-3fc3-453b-ae61-bacc13929354 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-changed-64455602-0478-47d7-9d50-551d552ceb26 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG nova.compute.manager [req-1763eeef-0167-404b-9ee1-98dc6cc51705 req-bb16a03e-3fc3-453b-ae61-bacc13929354 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing instance network info cache due to event network-changed-64455602-0478-47d7-9d50-551d552ceb26. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1763eeef-0167-404b-9ee1-98dc6cc51705 req-bb16a03e-3fc3-453b-ae61-bacc13929354 service nova] Acquiring lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1763eeef-0167-404b-9ee1-98dc6cc51705 req-bb16a03e-3fc3-453b-ae61-bacc13929354 service nova] Acquired lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG nova.network.neutron [req-1763eeef-0167-404b-9ee1-98dc6cc51705 req-bb16a03e-3fc3-453b-ae61-bacc13929354 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing network info cache for port 64455602-0478-47d7-9d50-551d552ceb26 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Successfully updated port: ff64a492-8e97-4c11-9207-bf56011d8a5d {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.184s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG nova.network.neutron [req-1763eeef-0167-404b-9ee1-98dc6cc51705 req-bb16a03e-3fc3-453b-ae61-bacc13929354 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk 1073741824" returned: 0 in 0.074s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.184s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Checking if we can resize image /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG nova.network.neutron [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Successfully created port: dde4f0a3-4573-4f17-aa86-fef9fd14059e {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:35 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Cannot resize image /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.objects.instance [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lazy-loading 'migration_context' on Instance uuid 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.network.neutron [req-1763eeef-0167-404b-9ee1-98dc6cc51705 req-bb16a03e-3fc3-453b-ae61-bacc13929354 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Ensure instance console log exists: /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1763eeef-0167-404b-9ee1-98dc6cc51705 req-bb16a03e-3fc3-453b-ae61-bacc13929354 service nova] Releasing lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Successfully updated port: 8e63fe4d-bc87-40cb-855e-ad82726ca39d {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquired lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-db3204fd-e748-49dd-9417-001874a4cdb7 req-f6bb835a-8614-4027-8f2e-0f714fb1dcc8 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-changed-8e63fe4d-bc87-40cb-855e-ad82726ca39d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-db3204fd-e748-49dd-9417-001874a4cdb7 req-f6bb835a-8614-4027-8f2e-0f714fb1dcc8 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing instance network info cache due to event network-changed-8e63fe4d-bc87-40cb-855e-ad82726ca39d. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-db3204fd-e748-49dd-9417-001874a4cdb7 req-f6bb835a-8614-4027-8f2e-0f714fb1dcc8 service nova] Acquiring lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating instance_info_cache with network_info: [{"id": "97d7d320-4ac2-41af-86ca-c30f00808f33", "address": "fa:16:3e:83:c6:aa", "network": {"id": "792a09f0-bb03-4d2c-a902-a533c081fdda", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1710316548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97d7d320-4a", "ovs_interfaceid": "97d7d320-4ac2-41af-86ca-c30f00808f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "address": "fa:16:3e:2d:63:6a", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4f98b7-b1", "ovs_interfaceid": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "089a686b-763d-41df-b624-291933367593", "address": "fa:16:3e:28:ca:6e", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap089a686b-76", "ovs_interfaceid": "089a686b-763d-41df-b624-291933367593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96beb287-2181-4df4-b835-a9f071ace5df", "address": "fa:16:3e:a8:73:9b", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96beb287-21", "ovs_interfaceid": "96beb287-2181-4df4-b835-a9f071ace5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "address": "fa:16:3e:01:92:b8", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a4f2864-33", "ovs_interfaceid": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "address": "fa:16:3e:3a:52:8a", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2904a0c-90", "ovs_interfaceid": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "address": "fa:16:3e:3b:18:e7", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d62e14d-6c", "ovs_interfaceid": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Releasing lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Instance network_info: |[{"id": "97d7d320-4ac2-41af-86ca-c30f00808f33", "address": "fa:16:3e:83:c6:aa", "network": {"id": "792a09f0-bb03-4d2c-a902-a533c081fdda", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1710316548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97d7d320-4a", "ovs_interfaceid": "97d7d320-4ac2-41af-86ca-c30f00808f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "address": "fa:16:3e:2d:63:6a", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4f98b7-b1", "ovs_interfaceid": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "089a686b-763d-41df-b624-291933367593", "address": "fa:16:3e:28:ca:6e", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap089a686b-76", "ovs_interfaceid": "089a686b-763d-41df-b624-291933367593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96beb287-2181-4df4-b835-a9f071ace5df", "address": "fa:16:3e:a8:73:9b", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96beb287-21", "ovs_interfaceid": "96beb287-2181-4df4-b835-a9f071ace5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "address": "fa:16:3e:01:92:b8", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a4f2864-33", "ovs_interfaceid": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "address": "fa:16:3e:3a:52:8a", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2904a0c-90", "ovs_interfaceid": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "address": "fa:16:3e:3b:18:e7", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d62e14d-6c", "ovs_interfaceid": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] Acquired lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.network.neutron [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing network info cache for port 1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.network.neutron [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Successfully updated port: dde4f0a3-4573-4f17-aa86-fef9fd14059e {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "refresh_cache-387e72a2-6fd9-4cd7-ab72-67535fc67fd5" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquired lock "refresh_cache-387e72a2-6fd9-4cd7-ab72-67535fc67fd5" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.network.neutron [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-1c113dcf-ea7d-4bf8-beb2-dcda580d4bc1 req-072f7f59-4b3d-47eb-a7a6-10d3e2c44830 service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Received event network-changed-dde4f0a3-4573-4f17-aa86-fef9fd14059e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-1c113dcf-ea7d-4bf8-beb2-dcda580d4bc1 req-072f7f59-4b3d-47eb-a7a6-10d3e2c44830 service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Refreshing instance network info cache due to event network-changed-dde4f0a3-4573-4f17-aa86-fef9fd14059e. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c113dcf-ea7d-4bf8-beb2-dcda580d4bc1 req-072f7f59-4b3d-47eb-a7a6-10d3e2c44830 service nova] Acquiring lock "refresh_cache-387e72a2-6fd9-4cd7-ab72-67535fc67fd5" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:36 user nova-compute[72019]: DEBUG nova.network.neutron [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.network.neutron [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Updating instance_info_cache with network_info: [{"id": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "address": "fa:16:3e:29:90:2f", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde4f0a3-45", "ovs_interfaceid": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Releasing lock "refresh_cache-387e72a2-6fd9-4cd7-ab72-67535fc67fd5" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.compute.manager [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Instance network_info: |[{"id": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "address": "fa:16:3e:29:90:2f", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde4f0a3-45", "ovs_interfaceid": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c113dcf-ea7d-4bf8-beb2-dcda580d4bc1 req-072f7f59-4b3d-47eb-a7a6-10d3e2c44830 service nova] Acquired lock "refresh_cache-387e72a2-6fd9-4cd7-ab72-67535fc67fd5" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.network.neutron [req-1c113dcf-ea7d-4bf8-beb2-dcda580d4bc1 req-072f7f59-4b3d-47eb-a7a6-10d3e2c44830 service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Refreshing network info cache for port dde4f0a3-4573-4f17-aa86-fef9fd14059e {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Start _get_guest_xml network_info=[{"id": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "address": "fa:16:3e:29:90:2f", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde4f0a3-45", "ovs_interfaceid": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:13:37 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:37 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1440515588',display_name='tempest-VolumesSnapshotTestJSON-instance-1440515588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1440515588',id=13,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fe64d1d65224162b60849eace352cb4',ramdisk_id='',reservation_id='r-3nnv165w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1137775211',owner_user_name='tempest-VolumesSnapshotTestJSON-1137775211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:35Z,user_data=None,user_id='0f3445d14b0a44fd999bc2fc875c77bb',uuid=387e72a2-6fd9-4cd7-ab72-67535fc67fd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "address": "fa:16:3e:29:90:2f", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde4f0a3-45", "ovs_interfaceid": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Converting VIF {"id": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "address": "fa:16:3e:29:90:2f", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde4f0a3-45", "ovs_interfaceid": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=dde4f0a3-4573-4f17-aa86-fef9fd14059e,network=Network(548d2c7a-ae94-4d89-8980-cb14f224fca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde4f0a3-45') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.objects.instance [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lazy-loading 'pci_devices' on Instance uuid 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.compute.manager [req-414422b7-c9a5-4e91-be9a-5b5c2760de4c req-6b82ce3f-7785-4066-928c-a3d6658aad5d service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-changed-ff64a492-8e97-4c11-9207-bf56011d8a5d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.compute.manager [req-414422b7-c9a5-4e91-be9a-5b5c2760de4c req-6b82ce3f-7785-4066-928c-a3d6658aad5d service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing instance network info cache due to event network-changed-ff64a492-8e97-4c11-9207-bf56011d8a5d. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-414422b7-c9a5-4e91-be9a-5b5c2760de4c req-6b82ce3f-7785-4066-928c-a3d6658aad5d service nova] Acquiring lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:13:37 user nova-compute[72019]:   <uuid>387e72a2-6fd9-4cd7-ab72-67535fc67fd5</uuid>
Apr 14 13:13:37 user nova-compute[72019]:   <name>instance-0000000d</name>
Apr 14 13:13:37 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:13:37 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:13:37 user nova-compute[72019]:   <metadata>
Apr 14 13:13:37 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:13:37 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:13:37 user nova-compute[72019]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1440515588</nova:name>
Apr 14 13:13:37 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:13:37</nova:creationTime>
Apr 14 13:13:37 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:13:37 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:13:37 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:13:37 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:13:37 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:13:37 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:13:37 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:13:37 user nova-compute[72019]:       <nova:owner>
Apr 14 13:13:37 user nova-compute[72019]:         <nova:user uuid="0f3445d14b0a44fd999bc2fc875c77bb">tempest-VolumesSnapshotTestJSON-1137775211-project-member</nova:user>
Apr 14 13:13:37 user nova-compute[72019]:         <nova:project uuid="4fe64d1d65224162b60849eace352cb4">tempest-VolumesSnapshotTestJSON-1137775211</nova:project>
Apr 14 13:13:37 user nova-compute[72019]:       </nova:owner>
Apr 14 13:13:37 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:13:37 user nova-compute[72019]:       <nova:ports>
Apr 14 13:13:37 user nova-compute[72019]:         <nova:port uuid="dde4f0a3-4573-4f17-aa86-fef9fd14059e">
Apr 14 13:13:37 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 14 13:13:37 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:37 user nova-compute[72019]:       </nova:ports>
Apr 14 13:13:37 user nova-compute[72019]:     </nova:instance>
Apr 14 13:13:37 user nova-compute[72019]:   </metadata>
Apr 14 13:13:37 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:13:37 user nova-compute[72019]:     <system>
Apr 14 13:13:37 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:13:37 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:13:37 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:13:37 user nova-compute[72019]:       <entry name="serial">387e72a2-6fd9-4cd7-ab72-67535fc67fd5</entry>
Apr 14 13:13:37 user nova-compute[72019]:       <entry name="uuid">387e72a2-6fd9-4cd7-ab72-67535fc67fd5</entry>
Apr 14 13:13:37 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:13:37 user nova-compute[72019]:     </system>
Apr 14 13:13:37 user nova-compute[72019]:   </sysinfo>
Apr 14 13:13:37 user nova-compute[72019]:   <os>
Apr 14 13:13:37 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:13:37 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:13:37 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:13:37 user nova-compute[72019]:   </os>
Apr 14 13:13:37 user nova-compute[72019]:   <features>
Apr 14 13:13:37 user nova-compute[72019]:     <acpi/>
Apr 14 13:13:37 user nova-compute[72019]:     <apic/>
Apr 14 13:13:37 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:13:37 user nova-compute[72019]:   </features>
Apr 14 13:13:37 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:13:37 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:13:37 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:13:37 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:13:37 user nova-compute[72019]:   </clock>
Apr 14 13:13:37 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:13:37 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:13:37 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:13:37 user nova-compute[72019]:   </cpu>
Apr 14 13:13:37 user nova-compute[72019]:   <devices>
Apr 14 13:13:37 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:13:37 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:13:37 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk"/>
Apr 14 13:13:37 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:13:37 user nova-compute[72019]:     </disk>
Apr 14 13:13:37 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:37 user nova-compute[72019]:       <mac address="fa:16:3e:29:90:2f"/>
Apr 14 13:13:37 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:37 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:37 user nova-compute[72019]:       <target dev="tapdde4f0a3-45"/>
Apr 14 13:13:37 user nova-compute[72019]:     </interface>
Apr 14 13:13:37 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:13:37 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/console.log" append="off"/>
Apr 14 13:13:37 user nova-compute[72019]:     </serial>
Apr 14 13:13:37 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:13:37 user nova-compute[72019]:     <video>
Apr 14 13:13:37 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:37 user nova-compute[72019]:     </video>
Apr 14 13:13:37 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:13:37 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:13:37 user nova-compute[72019]:     </rng>
Apr 14 13:13:37 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:13:37 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:13:37 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:13:37 user nova-compute[72019]:     </memballoon>
Apr 14 13:13:37 user nova-compute[72019]:   </devices>
Apr 14 13:13:37 user nova-compute[72019]: </domain>
Apr 14 13:13:37 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1440515588',display_name='tempest-VolumesSnapshotTestJSON-instance-1440515588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1440515588',id=13,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fe64d1d65224162b60849eace352cb4',ramdisk_id='',reservation_id='r-3nnv165w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1137775211',owner_user_name='tempest-VolumesSnapshotTestJSON-1137775211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:35Z,user_data=None,user_id='0f3445d14b0a44fd999bc2fc875c77bb',uuid=387e72a2-6fd9-4cd7-ab72-67535fc67fd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "address": "fa:16:3e:29:90:2f", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde4f0a3-45", "ovs_interfaceid": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Converting VIF {"id": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "address": "fa:16:3e:29:90:2f", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde4f0a3-45", "ovs_interfaceid": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=dde4f0a3-4573-4f17-aa86-fef9fd14059e,network=Network(548d2c7a-ae94-4d89-8980-cb14f224fca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde4f0a3-45') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG os_vif [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=dde4f0a3-4573-4f17-aa86-fef9fd14059e,network=Network(548d2c7a-ae94-4d89-8980-cb14f224fca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde4f0a3-45') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdde4f0a3-45, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdde4f0a3-45, col_values=(('external_ids', {'iface-id': 'dde4f0a3-4573-4f17-aa86-fef9fd14059e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:90:2f', 'vm-uuid': '387e72a2-6fd9-4cd7-ab72-67535fc67fd5'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:37 user nova-compute[72019]: INFO os_vif [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=dde4f0a3-4573-4f17-aa86-fef9fd14059e,network=Network(548d2c7a-ae94-4d89-8980-cb14f224fca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde4f0a3-45')
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] No VIF found with MAC fa:16:3e:29:90:2f, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.network.neutron [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updated VIF entry in instance network info cache for port 1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG nova.network.neutron [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating instance_info_cache with network_info: [{"id": "97d7d320-4ac2-41af-86ca-c30f00808f33", "address": "fa:16:3e:83:c6:aa", "network": {"id": "792a09f0-bb03-4d2c-a902-a533c081fdda", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1710316548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97d7d320-4a", "ovs_interfaceid": "97d7d320-4ac2-41af-86ca-c30f00808f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "address": "fa:16:3e:2d:63:6a", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4f98b7-b1", "ovs_interfaceid": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "089a686b-763d-41df-b624-291933367593", "address": "fa:16:3e:28:ca:6e", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap089a686b-76", "ovs_interfaceid": "089a686b-763d-41df-b624-291933367593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96beb287-2181-4df4-b835-a9f071ace5df", "address": "fa:16:3e:a8:73:9b", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96beb287-21", "ovs_interfaceid": "96beb287-2181-4df4-b835-a9f071ace5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "address": "fa:16:3e:01:92:b8", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a4f2864-33", "ovs_interfaceid": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "address": "fa:16:3e:3a:52:8a", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2904a0c-90", "ovs_interfaceid": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "address": "fa:16:3e:3b:18:e7", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d62e14d-6c", "ovs_interfaceid": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] Releasing lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:38 user nova-compute[72019]: DEBUG nova.network.neutron [req-1c113dcf-ea7d-4bf8-beb2-dcda580d4bc1 req-072f7f59-4b3d-47eb-a7a6-10d3e2c44830 service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Updated VIF entry in instance network info cache for port dde4f0a3-4573-4f17-aa86-fef9fd14059e. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:13:38 user nova-compute[72019]: DEBUG nova.network.neutron [req-1c113dcf-ea7d-4bf8-beb2-dcda580d4bc1 req-072f7f59-4b3d-47eb-a7a6-10d3e2c44830 service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Updating instance_info_cache with network_info: [{"id": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "address": "fa:16:3e:29:90:2f", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde4f0a3-45", "ovs_interfaceid": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c113dcf-ea7d-4bf8-beb2-dcda580d4bc1 req-072f7f59-4b3d-47eb-a7a6-10d3e2c44830 service nova] Releasing lock "refresh_cache-387e72a2-6fd9-4cd7-ab72-67535fc67fd5" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:38 user nova-compute[72019]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating instance_info_cache with network_info: [{"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "address": "fa:16:3e:30:86:89", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3adf3c-41", "ovs_interfaceid": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64455602-0478-47d7-9d50-551d552ceb26", "address": "fa:16:3e:d1:4a:1e", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64455602-04", "ovs_interfaceid": "64455602-0478-47d7-9d50-551d552ceb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "address": "fa:16:3e:50:00:be", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64a492-8e", "ovs_interfaceid": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Releasing lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:38 user nova-compute[72019]: DEBUG nova.compute.manager [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Instance network_info: |[{"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "address": "fa:16:3e:30:86:89", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3adf3c-41", "ovs_interfaceid": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64455602-0478-47d7-9d50-551d552ceb26", "address": "fa:16:3e:d1:4a:1e", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64455602-04", "ovs_interfaceid": "64455602-0478-47d7-9d50-551d552ceb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "address": "fa:16:3e:50:00:be", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64a492-8e", "ovs_interfaceid": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:13:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-db3204fd-e748-49dd-9417-001874a4cdb7 req-f6bb835a-8614-4027-8f2e-0f714fb1dcc8 service nova] Acquired lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:38 user nova-compute[72019]: DEBUG nova.network.neutron [req-db3204fd-e748-49dd-9417-001874a4cdb7 req-f6bb835a-8614-4027-8f2e-0f714fb1dcc8 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing network info cache for port 8e63fe4d-bc87-40cb-855e-ad82726ca39d {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-e67d1bbc-b4d2-471a-94d5-5aad5b4741d7 req-2122c248-780b-4798-af8d-d1ed56801c6c service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Received event network-vif-plugged-dde4f0a3-4573-4f17-aa86-fef9fd14059e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e67d1bbc-b4d2-471a-94d5-5aad5b4741d7 req-2122c248-780b-4798-af8d-d1ed56801c6c service nova] Acquiring lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e67d1bbc-b4d2-471a-94d5-5aad5b4741d7 req-2122c248-780b-4798-af8d-d1ed56801c6c service nova] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e67d1bbc-b4d2-471a-94d5-5aad5b4741d7 req-2122c248-780b-4798-af8d-d1ed56801c6c service nova] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-e67d1bbc-b4d2-471a-94d5-5aad5b4741d7 req-2122c248-780b-4798-af8d-d1ed56801c6c service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] No waiting events found dispatching network-vif-plugged-dde4f0a3-4573-4f17-aa86-fef9fd14059e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:39 user nova-compute[72019]: WARNING nova.compute.manager [req-e67d1bbc-b4d2-471a-94d5-5aad5b4741d7 req-2122c248-780b-4798-af8d-d1ed56801c6c service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Received unexpected event network-vif-plugged-dde4f0a3-4573-4f17-aa86-fef9fd14059e for instance with vm_state building and task_state spawning.
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.network.neutron [req-db3204fd-e748-49dd-9417-001874a4cdb7 req-f6bb835a-8614-4027-8f2e-0f714fb1dcc8 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updated VIF entry in instance network info cache for port 8e63fe4d-bc87-40cb-855e-ad82726ca39d. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.network.neutron [req-db3204fd-e748-49dd-9417-001874a4cdb7 req-f6bb835a-8614-4027-8f2e-0f714fb1dcc8 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating instance_info_cache with network_info: [{"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "address": "fa:16:3e:30:86:89", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3adf3c-41", "ovs_interfaceid": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64455602-0478-47d7-9d50-551d552ceb26", "address": "fa:16:3e:d1:4a:1e", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64455602-04", "ovs_interfaceid": "64455602-0478-47d7-9d50-551d552ceb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "address": "fa:16:3e:50:00:be", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64a492-8e", "ovs_interfaceid": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-db3204fd-e748-49dd-9417-001874a4cdb7 req-f6bb835a-8614-4027-8f2e-0f714fb1dcc8 service nova] Releasing lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-414422b7-c9a5-4e91-be9a-5b5c2760de4c req-6b82ce3f-7785-4066-928c-a3d6658aad5d service nova] Acquired lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.network.neutron [req-414422b7-c9a5-4e91-be9a-5b5c2760de4c req-6b82ce3f-7785-4066-928c-a3d6658aad5d service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing network info cache for port ff64a492-8e97-4c11-9207-bf56011d8a5d {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:13:39 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Creating image(s)
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Ensure instance console log exists: /opt/stack/data/nova/instances/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Start _get_guest_xml network_info=[{"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "address": "fa:16:3e:30:86:89", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3adf3c-41", "ovs_interfaceid": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64455602-0478-47d7-9d50-551d552ceb26", "address": "fa:16:3e:d1:4a:1e", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64455602-04", "ovs_interfaceid": "64455602-0478-47d7-9d50-551d552ceb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "address": "fa:16:3e:50:00:be", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64a492-8e", "ovs_interfaceid": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a84eef5f-ead4-4da3-afea-43fe98d33614', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHqwWrvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c9e3e27-e027-4e14-84a2-23ae2e5b1b93', 'attached_at': '', 'detached_at': '', 'volume_id': '2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5', 'serial': '2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '5f87d902-785a-4cb6-8bf3-349b6246de5a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eumCEiMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c9e3e27-e027-4e14-84a2-23ae2e5b1b93', 'attached_at': '', 'detached_at': '', 'volume_id': 'cfbc1718-f375-48f6-b94c-63ac9c4807a6', 'serial': 'cfbc1718-f375-48f6-b94c-63ac9c4807a6'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'b1c9a584-9052-443f-aa8c-fa2621e53ad2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVsINeDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c9e3e27-e027-4e14-84a2-23ae2e5b1b93', 'attached_at': '', 'detached_at': '', 'volume_id': '24475c44-054d-436f-b2f8-17918c27ccc1', 'serial': '24475c44-054d-436f-b2f8-17918c27ccc1'}, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:13:39 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:39 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connector [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Factory for ISCSI on None {{(pid=72019) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHqwWrvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:13:39 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:13:39 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:13:39 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f55050-0782-493b-9c8d-08261ccf149a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:13:39 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fa3a47-14bd-47d0-afad-4b4f1513c8a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5] added
Apr 14 13:13:39 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4953775-7187-4027-9bcd-2d591835dbf1]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce3d7dd-cb4c-4cf1-b912-bc3f43456b46]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHqwWrvB {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHqwWrvB" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a19e6f-65ef-43ea-ac56-e3c0424d62e2]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EHqwWrvB'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf05d31-f53a-484d-b060-774d2a49b7a9]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.network.neutron [req-414422b7-c9a5-4e91-be9a-5b5c2760de4c req-6b82ce3f-7785-4066-928c-a3d6658aad5d service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updated VIF entry in instance network info cache for port ff64a492-8e97-4c11-9207-bf56011d8a5d. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.network.neutron [req-414422b7-c9a5-4e91-be9a-5b5c2760de4c req-6b82ce3f-7785-4066-928c-a3d6658aad5d service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating instance_info_cache with network_info: [{"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "address": "fa:16:3e:30:86:89", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3adf3c-41", "ovs_interfaceid": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64455602-0478-47d7-9d50-551d552ceb26", "address": "fa:16:3e:d1:4a:1e", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64455602-04", "ovs_interfaceid": "64455602-0478-47d7-9d50-551d552ceb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "address": "fa:16:3e:50:00:be", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64a492-8e", "ovs_interfaceid": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ca2800-d3e0-4a39-921c-f8663befa8da]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 13:13:39 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 13:13:39 user nova-compute[72019]:  {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:13:39 user nova-compute[72019]: WARNING os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 13:13:39 user nova-compute[72019]: 
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-414422b7-c9a5-4e91-be9a-5b5c2760de4c req-6b82ce3f-7785-4066-928c-a3d6658aad5d service nova] Releasing lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:13:39 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Creating image(s)
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Ensure instance console log exists: /opt/stack/data/nova/instances/7cf6ed7d-a98e-4984-967c-148e1537a118/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Start _get_guest_xml network_info=[{"id": "97d7d320-4ac2-41af-86ca-c30f00808f33", "address": "fa:16:3e:83:c6:aa", "network": {"id": "792a09f0-bb03-4d2c-a902-a533c081fdda", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1710316548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97d7d320-4a", "ovs_interfaceid": "97d7d320-4ac2-41af-86ca-c30f00808f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "address": "fa:16:3e:2d:63:6a", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4f98b7-b1", "ovs_interfaceid": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "089a686b-763d-41df-b624-291933367593", "address": "fa:16:3e:28:ca:6e", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap089a686b-76", "ovs_interfaceid": "089a686b-763d-41df-b624-291933367593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96beb287-2181-4df4-b835-a9f071ace5df", "address": "fa:16:3e:a8:73:9b", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96beb287-21", "ovs_interfaceid": "96beb287-2181-4df4-b835-a9f071ace5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "address": "fa:16:3e:01:92:b8", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a4f2864-33", "ovs_interfaceid": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "address": "fa:16:3e:3a:52:8a", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2904a0c-90", "ovs_interfaceid": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "address": "fa:16:3e:3b:18:e7", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d62e14d-6c", "ovs_interfaceid": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '23a52692-01ea-4d92-b4ca-0f46e7c2c93c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOwsuxcS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7cf6ed7d-a98e-4984-967c-148e1537a118', 'attached_at': '', 'detached_at': '', 'volume_id': '6f1c3902-8299-4b2d-814c-3848a40fdb21', 'serial': '6f1c3902-8299-4b2d-814c-3848a40fdb21'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '87ce1bdc-6eef-4467-a65f-269cab9ce2fe', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqFesKXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7cf6ed7d-a98e-4984-967c-148e1537a118', 'attached_at': '', 'detached_at': '', 'volume_id': '09520b36-0291-4949-b4bd-5ef9452f1160', 'serial': '09520b36-0291-4949-b4bd-5ef9452f1160'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '722041f8-25ac-4f0e-beb0-9bf820bd8bcf', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBLOquFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7cf6ed7d-a98e-4984-967c-148e1537a118', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0db7698-a216-42b4-a592-80a4cb5568bc', 'serial': 'f0db7698-a216-42b4-a592-80a4cb5568bc'}, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:13:39 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:39 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOwsuxcS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:13:39 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[84596dee-03fc-4ec4-a999-6ea416096d7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5, portal: 172.16.0.220,3260]
Apr 14 13:13:39 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5, portal: 172.16.0.220,3260] successful.
Apr 14 13:13:39 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea804fe-9378-43d8-9e76-69c1a71511fe]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff18ec65-7185-4add-952d-981930fd9288]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:39 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:39 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91d982f-53fe-4e38-abe4-7852cb97981c]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:13:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHqwWrvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26263393231336133', 'path': '/dev/sdb'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263393231336133', 'path': '/dev/sdb'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.079s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:13:40 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:13:40 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:13:40 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:13:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcbb95b-459b-4bc6-a572-49ffe4a53488]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:13:40 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eumCEiMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:13:40 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:13:40 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[78782a03-f13d-44ef-a25d-3e32f3614787]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21] added
Apr 14 13:13:40 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:40 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[06969dd4-6ada-40a1-87f7-ae6539d81365]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa8750d-73b0-4b01-900d-5218e3f3aac3]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOwsuxcS {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOwsuxcS" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac88db33-6bf0-49dd-9ab0-1e2fb2defd38]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yOwsuxcS'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e046b69d-379d-49f8-9aa5-2d15c9753c05]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2320a962-4641-411e-a08b-ef3439301ae2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478021.1127007, 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:41 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] VM Resumed (Lifecycle Event)
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:13:41 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Instance spawned successfully.
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3e4d63-4bca-4bdd-8604-eb3f498b4a39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21, portal: 172.16.0.220,3260]
Apr 14 13:13:41 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21, portal: 172.16.0.220,3260] successful.
Apr 14 13:13:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e24a9f-8dac-4d6d-8b73-52d02f60fb41]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:41 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478021.1160498, 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:41 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] VM Started (Lifecycle Event)
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a862d36-1650-41a6-9997-76e5f9c54a36]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:41 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:41 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:41 user nova-compute[72019]: INFO nova.compute.manager [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Took 6.08 seconds to spawn the instance on the hypervisor.
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c913451-a212-4596-9e38-f8ae0d0e56e3]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOwsuxcS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:13:41 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-5a1e81d5-d8a9-4505-bf74-b4a83393a958 req-1c624de8-625b-42a2-9c99-335111aebfa1 service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Received event network-vif-plugged-dde4f0a3-4573-4f17-aa86-fef9fd14059e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5a1e81d5-d8a9-4505-bf74-b4a83393a958 req-1c624de8-625b-42a2-9c99-335111aebfa1 service nova] Acquiring lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5a1e81d5-d8a9-4505-bf74-b4a83393a958 req-1c624de8-625b-42a2-9c99-335111aebfa1 service nova] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5a1e81d5-d8a9-4505-bf74-b4a83393a958 req-1c624de8-625b-42a2-9c99-335111aebfa1 service nova] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-5a1e81d5-d8a9-4505-bf74-b4a83393a958 req-1c624de8-625b-42a2-9c99-335111aebfa1 service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] No waiting events found dispatching network-vif-plugged-dde4f0a3-4573-4f17-aa86-fef9fd14059e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:41 user nova-compute[72019]: WARNING nova.compute.manager [req-5a1e81d5-d8a9-4505-bf74-b4a83393a958 req-1c624de8-625b-42a2-9c99-335111aebfa1 service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Received unexpected event network-vif-plugged-dde4f0a3-4573-4f17-aa86-fef9fd14059e for instance with vm_state building and task_state spawning.
Apr 14 13:13:41 user nova-compute[72019]: INFO nova.compute.manager [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Took 7.41 seconds to build instance.
Apr 14 13:13:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.536s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] <== connect_volume: return (2408ms) {'type': 'block', 'scsi_wwn': '26131646466383562', 'path': '/dev/sdc'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131646466383562', 'path': '/dev/sdc'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.293s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:13:42 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:13:42 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d320cf-a7cc-499f-8bde-6bcb1fae828c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:13:42 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqFesKXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:13:42 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9870c0f-6d7f-457c-9f86-2aa74499c4e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6] added
Apr 14 13:13:42 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba582a43-0581-4a73-812f-1f794b3ce974]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d7bd31-b589-449f-bee1-7e31030c3c39]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eumCEiMg {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eumCEiMg" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[54821ca8-5a13-4dde-b814-4d3e82f28ea3]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eumCEiMg'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[177e25c5-9553-418e-bb6d-49262cd79d35]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef43643-cff9-437a-98aa-e141aa1fb973]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:42 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:42 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:42 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:42 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4293ffff-c588-4e0e-9dc0-764d49418846]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6, portal: 172.16.0.220,3260]
Apr 14 13:13:42 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6, portal: 172.16.0.220,3260] successful.
Apr 14 13:13:42 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ae28d0-39c4-4ee0-aa36-79313d0a8610]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c68c83-7f90-4779-9c1f-2793b50ed3d2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:42 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:42 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:13:42 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:42 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:42 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:13:42 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[759e3a64-cf6d-41b0-99fc-4261bda283f3]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:13:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eumCEiMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] <== connect_volume: return (2622ms) {'type': 'block', 'scsi_wwn': '23639343864336334', 'path': '/dev/sdd'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639343864336334', 'path': '/dev/sdd'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.300s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:13:43 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:13:43 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVsINeDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:13:43 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb333f71-fc73-4a30-8e74-303ad8d1d3eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:13:43 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccc8570-8999-47f1-9734-699d929302da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160] added
Apr 14 13:13:43 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[612cd321-093a-477d-9273-cbe4fb4c9aca]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eb3705-bf78-4e06-bc33-61f63acffbbc]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqFesKXU {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqFesKXU" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4d6079-a032-45b3-93e8-bc253f54e935]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HqFesKXU'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[185dcfc5-abb9-4199-9b02-7d15030d68b3]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6080ff-0750-4fe6-b541-ab018302d9b8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:43 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:43 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:13:43 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:43 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:43 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:13:43 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a069a54-891d-49e1-a4ed-a0ef694d3e04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160, portal: 172.16.0.220,3260]
Apr 14 13:13:43 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160, portal: 172.16.0.220,3260] successful.
Apr 14 13:13:43 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b332a8-cf89-4555-937e-5c7f6ccc5448]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb9609b-32a6-464f-8ce3-97a5e45c7614]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:43 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:43 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:13:43 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:13:43 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:43 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:43 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:13:43 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:13:43 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b54d39-9a7f-4411-a10c-fd5d3316f2da]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:43 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqFesKXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] <== connect_volume: return (2633ms) {'type': 'block', 'scsi_wwn': '26137653832303338', 'path': '/dev/sde'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137653832303338', 'path': '/dev/sde'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.305s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:13:44 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:13:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:13:44 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:13:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ecb008-24c4-4668-81c1-91d4e222af7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:13:44 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBLOquFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:13:44 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:13:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d3e547-6c54-4fd7-939d-5c8f55b02dbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1] added
Apr 14 13:13:44 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8479a9-07fd-45d6-af67-65126610e22d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e50c075-ef21-4e2b-8847-93210899f1f1]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVsINeDH {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVsINeDH" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f06be1c-519f-4045-bfb0-ab171a3f40ea]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cVsINeDH'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fd7f82-6295-4e92-807a-adbbde80e515]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae08acb-5648-4c67-b3e6-81ddc8af2496]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[573fe5c3-f300-4fe7-82a6-038e2c94c865]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1, portal: 172.16.0.220,3260]
Apr 14 13:13:45 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1, portal: 172.16.0.220,3260] successful.
Apr 14 13:13:45 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b725f700-99ec-4ed7-85e9-7d497212cf8c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcf82b4-68a6-4ccc-a510-892056f876d1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:13:45 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f14785-a957-4ede-9951-09edcf3b7a34]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:45 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVsINeDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] <== connect_volume: return (2641ms) {'type': 'block', 'scsi_wwn': '26365663033623337', 'path': '/dev/sdf'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365663033623337', 'path': '/dev/sdf'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.310s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:13:46 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:13:46 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbb0316-ae08-4b23-ab70-939a2334ceb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:13:46 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:75:b1,bridge_name='br-int',has_traffic_filtering=True,id=4fef6c1f-75be-46b1-b091-f3717d65bb21,network=Network(7e198958-bf78-4f31-a37f-fcf4eb24caa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fef6c1f-75') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:95:fe,bridge_name='br-int',has_traffic_filtering=True,id=3532d3d6-73ac-40eb-9486-d70fac78c992,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3532d3d6-73') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:92:cb,bridge_name='br-int',has_traffic_filtering=True,id=3929e20e-3bcb-4e87-bbb3-59f52e6e7047,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3929e20e-3b') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "address": "fa:16:3e:30:86:89", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3adf3c-41", "ovs_interfaceid": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "address": "fa:16:3e:30:86:89", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3adf3c-41", "ovs_interfaceid": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:86:89,bridge_name='br-int',has_traffic_filtering=True,id=3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3adf3c-41') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64455602-0478-47d7-9d50-551d552ceb26", "address": "fa:16:3e:d1:4a:1e", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64455602-04", "ovs_interfaceid": "64455602-0478-47d7-9d50-551d552ceb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "64455602-0478-47d7-9d50-551d552ceb26", "address": "fa:16:3e:d1:4a:1e", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64455602-04", "ovs_interfaceid": "64455602-0478-47d7-9d50-551d552ceb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:4a:1e,bridge_name='br-int',has_traffic_filtering=True,id=64455602-0478-47d7-9d50-551d552ceb26,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64455602-04') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "address": "fa:16:3e:50:00:be", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64a492-8e", "ovs_interfaceid": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "address": "fa:16:3e:50:00:be", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64a492-8e", "ovs_interfaceid": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:00:be,bridge_name='br-int',has_traffic_filtering=True,id=ff64a492-8e97-4c11-9207-bf56011d8a5d,network=Network(51c39db2-b137-4dff-8993-3a97bb48e38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64a492-8e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:db:85,bridge_name='br-int',has_traffic_filtering=True,id=8e63fe4d-bc87-40cb-855e-ad82726ca39d,network=Network(51c39db2-b137-4dff-8993-3a97bb48e38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e63fe4d-bc') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.objects.instance [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[855ccedb-04dd-4a2f-82b2-6ecc30817cd6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc] added
Apr 14 13:13:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:13:46 user nova-compute[72019]:   <uuid>7c9e3e27-e027-4e14-84a2-23ae2e5b1b93</uuid>
Apr 14 13:13:46 user nova-compute[72019]:   <name>instance-0000000c</name>
Apr 14 13:13:46 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:13:46 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:13:46 user nova-compute[72019]:   <metadata>
Apr 14 13:13:46 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:13:46 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:13:46 user nova-compute[72019]:       <nova:name>tempest-device-tagging-server-1364405608</nova:name>
Apr 14 13:13:46 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:13:39</nova:creationTime>
Apr 14 13:13:46 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:13:46 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:13:46 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:13:46 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:13:46 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:13:46 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:13:46 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:13:46 user nova-compute[72019]:       <nova:owner>
Apr 14 13:13:46 user nova-compute[72019]:         <nova:user uuid="213b7b010b7f40b0946ec1575216e80d">tempest-TaggedBootDevicesTest_v242-1237683370-project-member</nova:user>
Apr 14 13:13:46 user nova-compute[72019]:         <nova:project uuid="16235c48e6fb4457bbd7edfa321929a8">tempest-TaggedBootDevicesTest_v242-1237683370</nova:project>
Apr 14 13:13:46 user nova-compute[72019]:       </nova:owner>
Apr 14 13:13:46 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:13:46 user nova-compute[72019]:       <nova:ports>
Apr 14 13:13:46 user nova-compute[72019]:         <nova:port uuid="4fef6c1f-75be-46b1-b091-f3717d65bb21">
Apr 14 13:13:46 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 13:13:46 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:46 user nova-compute[72019]:         <nova:port uuid="3532d3d6-73ac-40eb-9486-d70fac78c992">
Apr 14 13:13:46 user nova-compute[72019]:           <nova:ip type="fixed" address="10.1.1.24" ipVersion="4"/>
Apr 14 13:13:46 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:46 user nova-compute[72019]:         <nova:port uuid="3929e20e-3bcb-4e87-bbb3-59f52e6e7047">
Apr 14 13:13:46 user nova-compute[72019]:           <nova:ip type="fixed" address="10.1.1.59" ipVersion="4"/>
Apr 14 13:13:46 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:46 user nova-compute[72019]:         <nova:port uuid="3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21">
Apr 14 13:13:46 user nova-compute[72019]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
Apr 14 13:13:46 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:46 user nova-compute[72019]:         <nova:port uuid="64455602-0478-47d7-9d50-551d552ceb26">
Apr 14 13:13:46 user nova-compute[72019]:           <nova:ip type="fixed" address="10.1.1.44" ipVersion="4"/>
Apr 14 13:13:46 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:46 user nova-compute[72019]:         <nova:port uuid="ff64a492-8e97-4c11-9207-bf56011d8a5d">
Apr 14 13:13:46 user nova-compute[72019]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 13:13:46 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:46 user nova-compute[72019]:         <nova:port uuid="8e63fe4d-bc87-40cb-855e-ad82726ca39d">
Apr 14 13:13:46 user nova-compute[72019]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 13:13:46 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:46 user nova-compute[72019]:       </nova:ports>
Apr 14 13:13:46 user nova-compute[72019]:     </nova:instance>
Apr 14 13:13:46 user nova-compute[72019]:   </metadata>
Apr 14 13:13:46 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:13:46 user nova-compute[72019]:     <system>
Apr 14 13:13:46 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:13:46 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:13:46 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:13:46 user nova-compute[72019]:       <entry name="serial">7c9e3e27-e027-4e14-84a2-23ae2e5b1b93</entry>
Apr 14 13:13:46 user nova-compute[72019]:       <entry name="uuid">7c9e3e27-e027-4e14-84a2-23ae2e5b1b93</entry>
Apr 14 13:13:46 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:13:46 user nova-compute[72019]:     </system>
Apr 14 13:13:46 user nova-compute[72019]:   </sysinfo>
Apr 14 13:13:46 user nova-compute[72019]:   <os>
Apr 14 13:13:46 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:13:46 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:13:46 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:13:46 user nova-compute[72019]:   </os>
Apr 14 13:13:46 user nova-compute[72019]:   <features>
Apr 14 13:13:46 user nova-compute[72019]:     <acpi/>
Apr 14 13:13:46 user nova-compute[72019]:     <apic/>
Apr 14 13:13:46 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:13:46 user nova-compute[72019]:   </features>
Apr 14 13:13:46 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:13:46 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:13:46 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:13:46 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:13:46 user nova-compute[72019]:   </clock>
Apr 14 13:13:46 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:13:46 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:13:46 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:13:46 user nova-compute[72019]:   </cpu>
Apr 14 13:13:46 user nova-compute[72019]:   <devices>
Apr 14 13:13:46 user nova-compute[72019]:     <disk type="file" device="cdrom">
Apr 14 13:13:46 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 13:13:46 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93/disk.config"/>
Apr 14 13:13:46 user nova-compute[72019]:       <target dev="hda" bus="ide"/>
Apr 14 13:13:46 user nova-compute[72019]:     </disk>
Apr 14 13:13:46 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:13:46 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:13:46 user nova-compute[72019]:       <source dev="/dev/sdb"/>
Apr 14 13:13:46 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:13:46 user nova-compute[72019]:       <serial>2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5</serial>
Apr 14 13:13:46 user nova-compute[72019]:     </disk>
Apr 14 13:13:46 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:13:46 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:13:46 user nova-compute[72019]:       <source dev="/dev/sdd"/>
Apr 14 13:13:46 user nova-compute[72019]:       <target dev="vdb" bus="virtio"/>
Apr 14 13:13:46 user nova-compute[72019]:       <serial>cfbc1718-f375-48f6-b94c-63ac9c4807a6</serial>
Apr 14 13:13:46 user nova-compute[72019]:     </disk>
Apr 14 13:13:46 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:13:46 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:13:46 user nova-compute[72019]:       <source dev="/dev/sdf"/>
Apr 14 13:13:46 user nova-compute[72019]:       <target dev="vdc" bus="virtio"/>
Apr 14 13:13:46 user nova-compute[72019]:       <serial>24475c44-054d-436f-b2f8-17918c27ccc1</serial>
Apr 14 13:13:46 user nova-compute[72019]:     </disk>
Apr 14 13:13:46 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:46 user nova-compute[72019]:       <mac address="fa:16:3e:76:75:b1"/>
Apr 14 13:13:46 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:46 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:46 user nova-compute[72019]:       <target dev="tap4fef6c1f-75"/>
Apr 14 13:13:46 user nova-compute[72019]:     </interface>
Apr 14 13:13:46 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:46 user nova-compute[72019]:       <mac address="fa:16:3e:b0:95:fe"/>
Apr 14 13:13:46 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:46 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:46 user nova-compute[72019]:       <target dev="tap3532d3d6-73"/>
Apr 14 13:13:46 user nova-compute[72019]:     </interface>
Apr 14 13:13:46 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:46 user nova-compute[72019]:       <mac address="fa:16:3e:e5:92:cb"/>
Apr 14 13:13:46 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:46 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:46 user nova-compute[72019]:       <target dev="tap3929e20e-3b"/>
Apr 14 13:13:46 user nova-compute[72019]:     </interface>
Apr 14 13:13:46 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:46 user nova-compute[72019]:       <mac address="fa:16:3e:30:86:89"/>
Apr 14 13:13:46 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:46 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:46 user nova-compute[72019]:       <target dev="tap3c3adf3c-41"/>
Apr 14 13:13:46 user nova-compute[72019]:     </interface>
Apr 14 13:13:46 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:46 user nova-compute[72019]:       <mac address="fa:16:3e:d1:4a:1e"/>
Apr 14 13:13:46 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:46 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:46 user nova-compute[72019]:       <target dev="tap64455602-04"/>
Apr 14 13:13:46 user nova-compute[72019]:     </interface>
Apr 14 13:13:46 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:46 user nova-compute[72019]:       <mac address="fa:16:3e:50:00:be"/>
Apr 14 13:13:46 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:46 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:46 user nova-compute[72019]:       <target dev="tapff64a492-8e"/>
Apr 14 13:13:46 user nova-compute[72019]:     </interface>
Apr 14 13:13:46 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:46 user nova-compute[72019]:       <mac address="fa:16:3e:6c:db:85"/>
Apr 14 13:13:46 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:46 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:46 user nova-compute[72019]:       <target dev="tap8e63fe4d-bc"/>
Apr 14 13:13:46 user nova-compute[72019]:     </interface>
Apr 14 13:13:46 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:13:46 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93/console.log" append="off"/>
Apr 14 13:13:46 user nova-compute[72019]:     </serial>
Apr 14 13:13:46 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:13:46 user nova-compute[72019]:     <video>
Apr 14 13:13:46 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:46 user nova-compute[72019]:     </video>
Apr 14 13:13:46 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:13:46 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:13:46 user nova-compute[72019]:     </rng>
Apr 14 13:13:46 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:13:46 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:13:46 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:13:46 user nova-compute[72019]:     </memballoon>
Apr 14 13:13:46 user nova-compute[72019]:   </devices>
Apr 14 13:13:46 user nova-compute[72019]: </domain>
Apr 14 13:13:46 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:75:b1,bridge_name='br-int',has_traffic_filtering=True,id=4fef6c1f-75be-46b1-b091-f3717d65bb21,network=Network(7e198958-bf78-4f31-a37f-fcf4eb24caa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fef6c1f-75') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:75:b1,bridge_name='br-int',has_traffic_filtering=True,id=4fef6c1f-75be-46b1-b091-f3717d65bb21,network=Network(7e198958-bf78-4f31-a37f-fcf4eb24caa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fef6c1f-75') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fef6c1f-75, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fef6c1f-75, col_values=(('external_ids', {'iface-id': '4fef6c1f-75be-46b1-b091-f3717d65bb21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:75:b1', 'vm-uuid': '7c9e3e27-e027-4e14-84a2-23ae2e5b1b93'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39ef339-33c4-4884-8d3c-934b31b81413]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: INFO os_vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:75:b1,bridge_name='br-int',has_traffic_filtering=True,id=4fef6c1f-75be-46b1-b091-f3717d65bb21,network=Network(7e198958-bf78-4f31-a37f-fcf4eb24caa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fef6c1f-75')
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:95:fe,bridge_name='br-int',has_traffic_filtering=True,id=3532d3d6-73ac-40eb-9486-d70fac78c992,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3532d3d6-73') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:95:fe,bridge_name='br-int',has_traffic_filtering=True,id=3532d3d6-73ac-40eb-9486-d70fac78c992,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3532d3d6-73') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3532d3d6-73, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3532d3d6-73, col_values=(('external_ids', {'iface-id': '3532d3d6-73ac-40eb-9486-d70fac78c992', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:95:fe', 'vm-uuid': '7c9e3e27-e027-4e14-84a2-23ae2e5b1b93'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[387fd84f-b7c3-478c-8ea1-3cf7784bc260]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBLOquFv {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: INFO os_vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:95:fe,bridge_name='br-int',has_traffic_filtering=True,id=3532d3d6-73ac-40eb-9486-d70fac78c992,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3532d3d6-73')
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:92:cb,bridge_name='br-int',has_traffic_filtering=True,id=3929e20e-3bcb-4e87-bbb3-59f52e6e7047,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3929e20e-3b') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:92:cb,bridge_name='br-int',has_traffic_filtering=True,id=3929e20e-3bcb-4e87-bbb3-59f52e6e7047,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3929e20e-3b') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBLOquFv" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e89c553-85a9-4107-b61d-476f9ce9b588]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HBLOquFv'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3929e20e-3b, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3929e20e-3b, col_values=(('external_ids', {'iface-id': '3929e20e-3bcb-4e87-bbb3-59f52e6e7047', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:92:cb', 'vm-uuid': '7c9e3e27-e027-4e14-84a2-23ae2e5b1b93'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e858ac1-120b-4d8e-8df5-c92eb55784d8]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: INFO os_vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:92:cb,bridge_name='br-int',has_traffic_filtering=True,id=3929e20e-3bcb-4e87-bbb3-59f52e6e7047,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3929e20e-3b')
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "address": "fa:16:3e:30:86:89", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3adf3c-41", "ovs_interfaceid": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "address": "fa:16:3e:30:86:89", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3adf3c-41", "ovs_interfaceid": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:86:89,bridge_name='br-int',has_traffic_filtering=True,id=3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3adf3c-41') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:86:89,bridge_name='br-int',has_traffic_filtering=True,id=3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3adf3c-41') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c3adf3c-41, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c3adf3c-41, col_values=(('external_ids', {'iface-id': '3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:86:89', 'vm-uuid': '7c9e3e27-e027-4e14-84a2-23ae2e5b1b93'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19095b5-952d-42ad-942f-e006c512e38c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: INFO os_vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:86:89,bridge_name='br-int',has_traffic_filtering=True,id=3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3adf3c-41')
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64455602-0478-47d7-9d50-551d552ceb26", "address": "fa:16:3e:d1:4a:1e", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64455602-04", "ovs_interfaceid": "64455602-0478-47d7-9d50-551d552ceb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "64455602-0478-47d7-9d50-551d552ceb26", "address": "fa:16:3e:d1:4a:1e", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64455602-04", "ovs_interfaceid": "64455602-0478-47d7-9d50-551d552ceb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:4a:1e,bridge_name='br-int',has_traffic_filtering=True,id=64455602-0478-47d7-9d50-551d552ceb26,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64455602-04') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:4a:1e,bridge_name='br-int',has_traffic_filtering=True,id=64455602-0478-47d7-9d50-551d552ceb26,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64455602-04') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64455602-04, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64455602-04, col_values=(('external_ids', {'iface-id': '64455602-0478-47d7-9d50-551d552ceb26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:4a:1e', 'vm-uuid': '7c9e3e27-e027-4e14-84a2-23ae2e5b1b93'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e7d8ce-fd57-4c73-9447-3956043a4280]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc, portal: 172.16.0.220,3260]
Apr 14 13:13:46 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc, portal: 172.16.0.220,3260] successful.
Apr 14 13:13:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: INFO os_vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:4a:1e,bridge_name='br-int',has_traffic_filtering=True,id=64455602-0478-47d7-9d50-551d552ceb26,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64455602-04')
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "address": "fa:16:3e:50:00:be", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64a492-8e", "ovs_interfaceid": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "address": "fa:16:3e:50:00:be", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64a492-8e", "ovs_interfaceid": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:00:be,bridge_name='br-int',has_traffic_filtering=True,id=ff64a492-8e97-4c11-9207-bf56011d8a5d,network=Network(51c39db2-b137-4dff-8993-3a97bb48e38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64a492-8e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:00:be,bridge_name='br-int',has_traffic_filtering=True,id=ff64a492-8e97-4c11-9207-bf56011d8a5d,network=Network(51c39db2-b137-4dff-8993-3a97bb48e38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64a492-8e') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff64a492-8e, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff64a492-8e, col_values=(('external_ids', {'iface-id': 'ff64a492-8e97-4c11-9207-bf56011d8a5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:00:be', 'vm-uuid': '7c9e3e27-e027-4e14-84a2-23ae2e5b1b93'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[929b858d-678a-4fb2-a928-9e020253f450]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[79548264-3a74-4664-89b4-c369258d1fd7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:13:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:13:46 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:13:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: INFO os_vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:00:be,bridge_name='br-int',has_traffic_filtering=True,id=ff64a492-8e97-4c11-9207-bf56011d8a5d,network=Network(51c39db2-b137-4dff-8993-3a97bb48e38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64a492-8e')
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:db:85,bridge_name='br-int',has_traffic_filtering=True,id=8e63fe4d-bc87-40cb-855e-ad82726ca39d,network=Network(51c39db2-b137-4dff-8993-3a97bb48e38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e63fe4d-bc') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:db:85,bridge_name='br-int',has_traffic_filtering=True,id=8e63fe4d-bc87-40cb-855e-ad82726ca39d,network=Network(51c39db2-b137-4dff-8993-3a97bb48e38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e63fe4d-bc') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e63fe4d-bc, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e63fe4d-bc, col_values=(('external_ids', {'iface-id': '8e63fe4d-bc87-40cb-855e-ad82726ca39d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:db:85', 'vm-uuid': '7c9e3e27-e027-4e14-84a2-23ae2e5b1b93'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe804221-66c7-4ccf-8b1e-b08fdbece147]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBLOquFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:46 user nova-compute[72019]: INFO os_vif [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:db:85,bridge_name='br-int',has_traffic_filtering=True,id=8e63fe4d-bc87-40cb-855e-ad82726ca39d,network=Network(51c39db2-b137-4dff-8993-3a97bb48e38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e63fe4d-bc')
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] No BDM found with device name hda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] No VIF found with MAC fa:16:3e:76:75:b1, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] No VIF found with MAC fa:16:3e:d1:4a:1e, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:13:46 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Using config drive
Apr 14 13:13:46 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Creating config drive at /opt/stack/data/nova/instances/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93/disk.config
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxoly2qca {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxoly2qca" returned: 0 in 0.053s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] <== connect_volume: return (2675ms) {'type': 'block', 'scsi_wwn': '26235333130363261', 'path': '/dev/sdg'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235333130363261', 'path': '/dev/sdg'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97d7d320-4ac2-41af-86ca-c30f00808f33", "address": "fa:16:3e:83:c6:aa", "network": {"id": "792a09f0-bb03-4d2c-a902-a533c081fdda", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1710316548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97d7d320-4a", "ovs_interfaceid": "97d7d320-4ac2-41af-86ca-c30f00808f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "97d7d320-4ac2-41af-86ca-c30f00808f33", "address": "fa:16:3e:83:c6:aa", "network": {"id": "792a09f0-bb03-4d2c-a902-a533c081fdda", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1710316548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97d7d320-4a", "ovs_interfaceid": "97d7d320-4ac2-41af-86ca-c30f00808f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c6:aa,bridge_name='br-int',has_traffic_filtering=True,id=97d7d320-4ac2-41af-86ca-c30f00808f33,network=Network(792a09f0-bb03-4d2c-a902-a533c081fdda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97d7d320-4a') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "address": "fa:16:3e:2d:63:6a", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4f98b7-b1", "ovs_interfaceid": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "address": "fa:16:3e:2d:63:6a", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4f98b7-b1", "ovs_interfaceid": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:63:6a,bridge_name='br-int',has_traffic_filtering=True,id=ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec4f98b7-b1') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "089a686b-763d-41df-b624-291933367593", "address": "fa:16:3e:28:ca:6e", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap089a686b-76", "ovs_interfaceid": "089a686b-763d-41df-b624-291933367593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "089a686b-763d-41df-b624-291933367593", "address": "fa:16:3e:28:ca:6e", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap089a686b-76", "ovs_interfaceid": "089a686b-763d-41df-b624-291933367593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ca:6e,bridge_name='br-int',has_traffic_filtering=True,id=089a686b-763d-41df-b624-291933367593,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap089a686b-76') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96beb287-2181-4df4-b835-a9f071ace5df", "address": "fa:16:3e:a8:73:9b", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96beb287-21", "ovs_interfaceid": "96beb287-2181-4df4-b835-a9f071ace5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "96beb287-2181-4df4-b835-a9f071ace5df", "address": "fa:16:3e:a8:73:9b", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96beb287-21", "ovs_interfaceid": "96beb287-2181-4df4-b835-a9f071ace5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:73:9b,bridge_name='br-int',has_traffic_filtering=True,id=96beb287-2181-4df4-b835-a9f071ace5df,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96beb287-21') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "address": "fa:16:3e:01:92:b8", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a4f2864-33", "ovs_interfaceid": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "address": "fa:16:3e:01:92:b8", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a4f2864-33", "ovs_interfaceid": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:92:b8,bridge_name='br-int',has_traffic_filtering=True,id=8a4f2864-33fc-4666-bb51-bdd01bc07af4,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a4f2864-33') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "address": "fa:16:3e:3a:52:8a", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2904a0c-90", "ovs_interfaceid": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "address": "fa:16:3e:3a:52:8a", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2904a0c-90", "ovs_interfaceid": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:52:8a,bridge_name='br-int',has_traffic_filtering=True,id=c2904a0c-904d-4dc3-9ffc-aaa05e253319,network=Network(b79d1aea-eb7d-4506-88ad-47003a3aa2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2904a0c-90') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "address": "fa:16:3e:3b:18:e7", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d62e14d-6c", "ovs_interfaceid": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "address": "fa:16:3e:3b:18:e7", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d62e14d-6c", "ovs_interfaceid": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:18:e7,bridge_name='br-int',has_traffic_filtering=True,id=1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf,network=Network(b79d1aea-eb7d-4506-88ad-47003a3aa2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d62e14d-6c') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cf6ed7d-a98e-4984-967c-148e1537a118 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:13:47 user nova-compute[72019]:   <uuid>7cf6ed7d-a98e-4984-967c-148e1537a118</uuid>
Apr 14 13:13:47 user nova-compute[72019]:   <name>instance-0000000b</name>
Apr 14 13:13:47 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:13:47 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:13:47 user nova-compute[72019]:   <metadata>
Apr 14 13:13:47 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:13:47 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:13:47 user nova-compute[72019]:       <nova:name>tempest-device-tagging-server-1062604462</nova:name>
Apr 14 13:13:47 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:13:39</nova:creationTime>
Apr 14 13:13:47 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:13:47 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:13:47 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:13:47 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:13:47 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:13:47 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:13:47 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:13:47 user nova-compute[72019]:       <nova:owner>
Apr 14 13:13:47 user nova-compute[72019]:         <nova:user uuid="e7115dcde1a6480e9e2db9cb8d4fdad3">tempest-TaggedBootDevicesTest-1775550058-project-member</nova:user>
Apr 14 13:13:47 user nova-compute[72019]:         <nova:project uuid="c9b68596374d4b918a83f403f2f25143">tempest-TaggedBootDevicesTest-1775550058</nova:project>
Apr 14 13:13:47 user nova-compute[72019]:       </nova:owner>
Apr 14 13:13:47 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:13:47 user nova-compute[72019]:       <nova:ports>
Apr 14 13:13:47 user nova-compute[72019]:         <nova:port uuid="97d7d320-4ac2-41af-86ca-c30f00808f33">
Apr 14 13:13:47 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 13:13:47 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:47 user nova-compute[72019]:         <nova:port uuid="ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a">
Apr 14 13:13:47 user nova-compute[72019]:           <nova:ip type="fixed" address="10.1.1.78" ipVersion="4"/>
Apr 14 13:13:47 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:47 user nova-compute[72019]:         <nova:port uuid="089a686b-763d-41df-b624-291933367593">
Apr 14 13:13:47 user nova-compute[72019]:           <nova:ip type="fixed" address="10.1.1.136" ipVersion="4"/>
Apr 14 13:13:47 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:47 user nova-compute[72019]:         <nova:port uuid="96beb287-2181-4df4-b835-a9f071ace5df">
Apr 14 13:13:47 user nova-compute[72019]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
Apr 14 13:13:47 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:47 user nova-compute[72019]:         <nova:port uuid="8a4f2864-33fc-4666-bb51-bdd01bc07af4">
Apr 14 13:13:47 user nova-compute[72019]:           <nova:ip type="fixed" address="10.1.1.40" ipVersion="4"/>
Apr 14 13:13:47 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:47 user nova-compute[72019]:         <nova:port uuid="c2904a0c-904d-4dc3-9ffc-aaa05e253319">
Apr 14 13:13:47 user nova-compute[72019]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 13:13:47 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:47 user nova-compute[72019]:         <nova:port uuid="1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf">
Apr 14 13:13:47 user nova-compute[72019]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 13:13:47 user nova-compute[72019]:         </nova:port>
Apr 14 13:13:47 user nova-compute[72019]:       </nova:ports>
Apr 14 13:13:47 user nova-compute[72019]:     </nova:instance>
Apr 14 13:13:47 user nova-compute[72019]:   </metadata>
Apr 14 13:13:47 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:13:47 user nova-compute[72019]:     <system>
Apr 14 13:13:47 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:13:47 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:13:47 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:13:47 user nova-compute[72019]:       <entry name="serial">7cf6ed7d-a98e-4984-967c-148e1537a118</entry>
Apr 14 13:13:47 user nova-compute[72019]:       <entry name="uuid">7cf6ed7d-a98e-4984-967c-148e1537a118</entry>
Apr 14 13:13:47 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:13:47 user nova-compute[72019]:     </system>
Apr 14 13:13:47 user nova-compute[72019]:   </sysinfo>
Apr 14 13:13:47 user nova-compute[72019]:   <os>
Apr 14 13:13:47 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:13:47 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:13:47 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:13:47 user nova-compute[72019]:   </os>
Apr 14 13:13:47 user nova-compute[72019]:   <features>
Apr 14 13:13:47 user nova-compute[72019]:     <acpi/>
Apr 14 13:13:47 user nova-compute[72019]:     <apic/>
Apr 14 13:13:47 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:13:47 user nova-compute[72019]:   </features>
Apr 14 13:13:47 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:13:47 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:13:47 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:13:47 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:13:47 user nova-compute[72019]:   </clock>
Apr 14 13:13:47 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:13:47 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:13:47 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:13:47 user nova-compute[72019]:   </cpu>
Apr 14 13:13:47 user nova-compute[72019]:   <devices>
Apr 14 13:13:47 user nova-compute[72019]:     <disk type="file" device="cdrom">
Apr 14 13:13:47 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 13:13:47 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/7cf6ed7d-a98e-4984-967c-148e1537a118/disk.config"/>
Apr 14 13:13:47 user nova-compute[72019]:       <target dev="hda" bus="ide"/>
Apr 14 13:13:47 user nova-compute[72019]:     </disk>
Apr 14 13:13:47 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:13:47 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:13:47 user nova-compute[72019]:       <source dev="/dev/sdc"/>
Apr 14 13:13:47 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:13:47 user nova-compute[72019]:       <serial>6f1c3902-8299-4b2d-814c-3848a40fdb21</serial>
Apr 14 13:13:47 user nova-compute[72019]:     </disk>
Apr 14 13:13:47 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:13:47 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:13:47 user nova-compute[72019]:       <source dev="/dev/sde"/>
Apr 14 13:13:47 user nova-compute[72019]:       <target dev="vdb" bus="virtio"/>
Apr 14 13:13:47 user nova-compute[72019]:       <serial>09520b36-0291-4949-b4bd-5ef9452f1160</serial>
Apr 14 13:13:47 user nova-compute[72019]:     </disk>
Apr 14 13:13:47 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:13:47 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:13:47 user nova-compute[72019]:       <source dev="/dev/sdg"/>
Apr 14 13:13:47 user nova-compute[72019]:       <target dev="vdc" bus="virtio"/>
Apr 14 13:13:47 user nova-compute[72019]:       <serial>f0db7698-a216-42b4-a592-80a4cb5568bc</serial>
Apr 14 13:13:47 user nova-compute[72019]:     </disk>
Apr 14 13:13:47 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:47 user nova-compute[72019]:       <mac address="fa:16:3e:83:c6:aa"/>
Apr 14 13:13:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:47 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:47 user nova-compute[72019]:       <target dev="tap97d7d320-4a"/>
Apr 14 13:13:47 user nova-compute[72019]:     </interface>
Apr 14 13:13:47 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:47 user nova-compute[72019]:       <mac address="fa:16:3e:2d:63:6a"/>
Apr 14 13:13:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:47 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:47 user nova-compute[72019]:       <target dev="tapec4f98b7-b1"/>
Apr 14 13:13:47 user nova-compute[72019]:     </interface>
Apr 14 13:13:47 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:47 user nova-compute[72019]:       <mac address="fa:16:3e:28:ca:6e"/>
Apr 14 13:13:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:47 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:47 user nova-compute[72019]:       <target dev="tap089a686b-76"/>
Apr 14 13:13:47 user nova-compute[72019]:     </interface>
Apr 14 13:13:47 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:47 user nova-compute[72019]:       <mac address="fa:16:3e:a8:73:9b"/>
Apr 14 13:13:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:47 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:47 user nova-compute[72019]:       <target dev="tap96beb287-21"/>
Apr 14 13:13:47 user nova-compute[72019]:     </interface>
Apr 14 13:13:47 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:47 user nova-compute[72019]:       <mac address="fa:16:3e:01:92:b8"/>
Apr 14 13:13:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:47 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:47 user nova-compute[72019]:       <target dev="tap8a4f2864-33"/>
Apr 14 13:13:47 user nova-compute[72019]:     </interface>
Apr 14 13:13:47 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:47 user nova-compute[72019]:       <mac address="fa:16:3e:3a:52:8a"/>
Apr 14 13:13:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:47 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:47 user nova-compute[72019]:       <target dev="tapc2904a0c-90"/>
Apr 14 13:13:47 user nova-compute[72019]:     </interface>
Apr 14 13:13:47 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:13:47 user nova-compute[72019]:       <mac address="fa:16:3e:3b:18:e7"/>
Apr 14 13:13:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:47 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:13:47 user nova-compute[72019]:       <target dev="tap1d62e14d-6c"/>
Apr 14 13:13:47 user nova-compute[72019]:     </interface>
Apr 14 13:13:47 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:13:47 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/7cf6ed7d-a98e-4984-967c-148e1537a118/console.log" append="off"/>
Apr 14 13:13:47 user nova-compute[72019]:     </serial>
Apr 14 13:13:47 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:13:47 user nova-compute[72019]:     <video>
Apr 14 13:13:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:13:47 user nova-compute[72019]:     </video>
Apr 14 13:13:47 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:13:47 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:13:47 user nova-compute[72019]:     </rng>
Apr 14 13:13:47 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:13:47 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:13:47 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:13:47 user nova-compute[72019]:     </memballoon>
Apr 14 13:13:47 user nova-compute[72019]:   </devices>
Apr 14 13:13:47 user nova-compute[72019]: </domain>
Apr 14 13:13:47 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97d7d320-4ac2-41af-86ca-c30f00808f33", "address": "fa:16:3e:83:c6:aa", "network": {"id": "792a09f0-bb03-4d2c-a902-a533c081fdda", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1710316548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97d7d320-4a", "ovs_interfaceid": "97d7d320-4ac2-41af-86ca-c30f00808f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "97d7d320-4ac2-41af-86ca-c30f00808f33", "address": "fa:16:3e:83:c6:aa", "network": {"id": "792a09f0-bb03-4d2c-a902-a533c081fdda", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1710316548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97d7d320-4a", "ovs_interfaceid": "97d7d320-4ac2-41af-86ca-c30f00808f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c6:aa,bridge_name='br-int',has_traffic_filtering=True,id=97d7d320-4ac2-41af-86ca-c30f00808f33,network=Network(792a09f0-bb03-4d2c-a902-a533c081fdda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97d7d320-4a') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG os_vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c6:aa,bridge_name='br-int',has_traffic_filtering=True,id=97d7d320-4ac2-41af-86ca-c30f00808f33,network=Network(792a09f0-bb03-4d2c-a902-a533c081fdda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97d7d320-4a') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97d7d320-4a, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap97d7d320-4a, col_values=(('external_ids', {'iface-id': '97d7d320-4ac2-41af-86ca-c30f00808f33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:c6:aa', 'vm-uuid': '7cf6ed7d-a98e-4984-967c-148e1537a118'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: INFO os_vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c6:aa,bridge_name='br-int',has_traffic_filtering=True,id=97d7d320-4ac2-41af-86ca-c30f00808f33,network=Network(792a09f0-bb03-4d2c-a902-a533c081fdda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97d7d320-4a')
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "address": "fa:16:3e:2d:63:6a", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4f98b7-b1", "ovs_interfaceid": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "address": "fa:16:3e:2d:63:6a", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4f98b7-b1", "ovs_interfaceid": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:63:6a,bridge_name='br-int',has_traffic_filtering=True,id=ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec4f98b7-b1') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG os_vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:63:6a,bridge_name='br-int',has_traffic_filtering=True,id=ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec4f98b7-b1') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec4f98b7-b1, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec4f98b7-b1, col_values=(('external_ids', {'iface-id': 'ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:63:6a', 'vm-uuid': '7cf6ed7d-a98e-4984-967c-148e1537a118'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: INFO os_vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:63:6a,bridge_name='br-int',has_traffic_filtering=True,id=ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec4f98b7-b1')
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "089a686b-763d-41df-b624-291933367593", "address": "fa:16:3e:28:ca:6e", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap089a686b-76", "ovs_interfaceid": "089a686b-763d-41df-b624-291933367593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "089a686b-763d-41df-b624-291933367593", "address": "fa:16:3e:28:ca:6e", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap089a686b-76", "ovs_interfaceid": "089a686b-763d-41df-b624-291933367593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ca:6e,bridge_name='br-int',has_traffic_filtering=True,id=089a686b-763d-41df-b624-291933367593,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap089a686b-76') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG os_vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ca:6e,bridge_name='br-int',has_traffic_filtering=True,id=089a686b-763d-41df-b624-291933367593,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap089a686b-76') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap089a686b-76, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap089a686b-76, col_values=(('external_ids', {'iface-id': '089a686b-763d-41df-b624-291933367593', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:ca:6e', 'vm-uuid': '7cf6ed7d-a98e-4984-967c-148e1537a118'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: INFO os_vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ca:6e,bridge_name='br-int',has_traffic_filtering=True,id=089a686b-763d-41df-b624-291933367593,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap089a686b-76')
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96beb287-2181-4df4-b835-a9f071ace5df", "address": "fa:16:3e:a8:73:9b", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96beb287-21", "ovs_interfaceid": "96beb287-2181-4df4-b835-a9f071ace5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "96beb287-2181-4df4-b835-a9f071ace5df", "address": "fa:16:3e:a8:73:9b", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96beb287-21", "ovs_interfaceid": "96beb287-2181-4df4-b835-a9f071ace5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:73:9b,bridge_name='br-int',has_traffic_filtering=True,id=96beb287-2181-4df4-b835-a9f071ace5df,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96beb287-21') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG os_vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:73:9b,bridge_name='br-int',has_traffic_filtering=True,id=96beb287-2181-4df4-b835-a9f071ace5df,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96beb287-21') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96beb287-21, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96beb287-21, col_values=(('external_ids', {'iface-id': '96beb287-2181-4df4-b835-a9f071ace5df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:73:9b', 'vm-uuid': '7cf6ed7d-a98e-4984-967c-148e1537a118'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: INFO os_vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:73:9b,bridge_name='br-int',has_traffic_filtering=True,id=96beb287-2181-4df4-b835-a9f071ace5df,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96beb287-21')
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "address": "fa:16:3e:01:92:b8", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a4f2864-33", "ovs_interfaceid": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "address": "fa:16:3e:01:92:b8", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a4f2864-33", "ovs_interfaceid": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:92:b8,bridge_name='br-int',has_traffic_filtering=True,id=8a4f2864-33fc-4666-bb51-bdd01bc07af4,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a4f2864-33') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG os_vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:92:b8,bridge_name='br-int',has_traffic_filtering=True,id=8a4f2864-33fc-4666-bb51-bdd01bc07af4,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a4f2864-33') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a4f2864-33, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a4f2864-33, col_values=(('external_ids', {'iface-id': '8a4f2864-33fc-4666-bb51-bdd01bc07af4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:92:b8', 'vm-uuid': '7cf6ed7d-a98e-4984-967c-148e1537a118'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: INFO os_vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:92:b8,bridge_name='br-int',has_traffic_filtering=True,id=8a4f2864-33fc-4666-bb51-bdd01bc07af4,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a4f2864-33')
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "address": "fa:16:3e:3a:52:8a", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2904a0c-90", "ovs_interfaceid": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "address": "fa:16:3e:3a:52:8a", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2904a0c-90", "ovs_interfaceid": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:52:8a,bridge_name='br-int',has_traffic_filtering=True,id=c2904a0c-904d-4dc3-9ffc-aaa05e253319,network=Network(b79d1aea-eb7d-4506-88ad-47003a3aa2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2904a0c-90') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG os_vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:52:8a,bridge_name='br-int',has_traffic_filtering=True,id=c2904a0c-904d-4dc3-9ffc-aaa05e253319,network=Network(b79d1aea-eb7d-4506-88ad-47003a3aa2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2904a0c-90') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2904a0c-90, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc2904a0c-90, col_values=(('external_ids', {'iface-id': 'c2904a0c-904d-4dc3-9ffc-aaa05e253319', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:52:8a', 'vm-uuid': '7cf6ed7d-a98e-4984-967c-148e1537a118'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: INFO os_vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:52:8a,bridge_name='br-int',has_traffic_filtering=True,id=c2904a0c-904d-4dc3-9ffc-aaa05e253319,network=Network(b79d1aea-eb7d-4506-88ad-47003a3aa2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2904a0c-90')
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "address": "fa:16:3e:3b:18:e7", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d62e14d-6c", "ovs_interfaceid": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "address": "fa:16:3e:3b:18:e7", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d62e14d-6c", "ovs_interfaceid": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:18:e7,bridge_name='br-int',has_traffic_filtering=True,id=1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf,network=Network(b79d1aea-eb7d-4506-88ad-47003a3aa2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d62e14d-6c') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG os_vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:18:e7,bridge_name='br-int',has_traffic_filtering=True,id=1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf,network=Network(b79d1aea-eb7d-4506-88ad-47003a3aa2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d62e14d-6c') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d62e14d-6c, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d62e14d-6c, col_values=(('external_ids', {'iface-id': '1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:18:e7', 'vm-uuid': '7cf6ed7d-a98e-4984-967c-148e1537a118'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: INFO os_vif [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:18:e7,bridge_name='br-int',has_traffic_filtering=True,id=1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf,network=Network(b79d1aea-eb7d-4506-88ad-47003a3aa2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d62e14d-6c')
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] No BDM found with device name hda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] No VIF found with MAC fa:16:3e:83:c6:aa, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] No VIF found with MAC fa:16:3e:01:92:b8, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:13:48 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Using config drive
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.compute.manager [req-8ba901cf-1dae-4036-82aa-d1ca62e1563d req-98a37297-917b-4d46-93f7-762e5dcde571 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8ba901cf-1dae-4036-82aa-d1ca62e1563d req-98a37297-917b-4d46-93f7-762e5dcde571 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8ba901cf-1dae-4036-82aa-d1ca62e1563d req-98a37297-917b-4d46-93f7-762e5dcde571 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8ba901cf-1dae-4036-82aa-d1ca62e1563d req-98a37297-917b-4d46-93f7-762e5dcde571 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG nova.compute.manager [req-8ba901cf-1dae-4036-82aa-d1ca62e1563d req-98a37297-917b-4d46-93f7-762e5dcde571 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:48 user nova-compute[72019]: WARNING nova.compute.manager [req-8ba901cf-1dae-4036-82aa-d1ca62e1563d req-98a37297-917b-4d46-93f7-762e5dcde571 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-4fef6c1f-75be-46b1-b091-f3717d65bb21 for instance with vm_state building and task_state spawning.
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Creating config drive at /opt/stack/data/nova/instances/7cf6ed7d-a98e-4984-967c-148e1537a118/disk.config
Apr 14 13:13:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7cf6ed7d-a98e-4984-967c-148e1537a118/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq1dsuqtc {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7cf6ed7d-a98e-4984-967c-148e1537a118/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq1dsuqtc" returned: 0 in 0.062s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:13:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-d1876d74-9e49-4590-985c-dcc31c66210b req-58257394-6224-463a-ac4a-24f5bbfab885 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-3532d3d6-73ac-40eb-9486-d70fac78c992 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d1876d74-9e49-4590-985c-dcc31c66210b req-58257394-6224-463a-ac4a-24f5bbfab885 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d1876d74-9e49-4590-985c-dcc31c66210b req-58257394-6224-463a-ac4a-24f5bbfab885 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d1876d74-9e49-4590-985c-dcc31c66210b req-58257394-6224-463a-ac4a-24f5bbfab885 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-d1876d74-9e49-4590-985c-dcc31c66210b req-58257394-6224-463a-ac4a-24f5bbfab885 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-3532d3d6-73ac-40eb-9486-d70fac78c992 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:49 user nova-compute[72019]: WARNING nova.compute.manager [req-d1876d74-9e49-4590-985c-dcc31c66210b req-58257394-6224-463a-ac4a-24f5bbfab885 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-3532d3d6-73ac-40eb-9486-d70fac78c992 for instance with vm_state building and task_state spawning.
Apr 14 13:13:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:50 user nova-compute[72019]: WARNING nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-4fef6c1f-75be-46b1-b091-f3717d65bb21 for instance with vm_state building and task_state spawning.
Apr 14 13:13:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-3929e20e-3bcb-4e87-bbb3-59f52e6e7047 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-3929e20e-3bcb-4e87-bbb3-59f52e6e7047 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:50 user nova-compute[72019]: WARNING nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-3929e20e-3bcb-4e87-bbb3-59f52e6e7047 for instance with vm_state building and task_state spawning.
Apr 14 13:13:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-3929e20e-3bcb-4e87-bbb3-59f52e6e7047 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-3929e20e-3bcb-4e87-bbb3-59f52e6e7047 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:50 user nova-compute[72019]: WARNING nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-3929e20e-3bcb-4e87-bbb3-59f52e6e7047 for instance with vm_state building and task_state spawning.
Apr 14 13:13:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-64455602-0478-47d7-9d50-551d552ceb26 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-64455602-0478-47d7-9d50-551d552ceb26 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:50 user nova-compute[72019]: WARNING nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-64455602-0478-47d7-9d50-551d552ceb26 for instance with vm_state building and task_state spawning.
Apr 14 13:13:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-64455602-0478-47d7-9d50-551d552ceb26 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-64455602-0478-47d7-9d50-551d552ceb26 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:50 user nova-compute[72019]: WARNING nova.compute.manager [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-64455602-0478-47d7-9d50-551d552ceb26 for instance with vm_state building and task_state spawning.
Apr 14 13:13:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-3532d3d6-73ac-40eb-9486-d70fac78c992 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-3532d3d6-73ac-40eb-9486-d70fac78c992 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:51 user nova-compute[72019]: WARNING nova.compute.manager [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-3532d3d6-73ac-40eb-9486-d70fac78c992 for instance with vm_state building and task_state spawning.
Apr 14 13:13:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:51 user nova-compute[72019]: WARNING nova.compute.manager [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 for instance with vm_state building and task_state spawning.
Apr 14 13:13:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:51 user nova-compute[72019]: WARNING nova.compute.manager [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 for instance with vm_state building and task_state spawning.
Apr 14 13:13:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-14002c58-1e7f-437a-9d51-0d44dea27afd req-a0ab7f93-14d8-4cba-99d3-b9a36a20e2c8 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-8e63fe4d-bc87-40cb-855e-ad82726ca39d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-14002c58-1e7f-437a-9d51-0d44dea27afd req-a0ab7f93-14d8-4cba-99d3-b9a36a20e2c8 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-14002c58-1e7f-437a-9d51-0d44dea27afd req-a0ab7f93-14d8-4cba-99d3-b9a36a20e2c8 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-14002c58-1e7f-437a-9d51-0d44dea27afd req-a0ab7f93-14d8-4cba-99d3-b9a36a20e2c8 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-14002c58-1e7f-437a-9d51-0d44dea27afd req-a0ab7f93-14d8-4cba-99d3-b9a36a20e2c8 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-8e63fe4d-bc87-40cb-855e-ad82726ca39d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:51 user nova-compute[72019]: WARNING nova.compute.manager [req-14002c58-1e7f-437a-9d51-0d44dea27afd req-a0ab7f93-14d8-4cba-99d3-b9a36a20e2c8 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-8e63fe4d-bc87-40cb-855e-ad82726ca39d for instance with vm_state building and task_state spawning.
Apr 14 13:13:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG nova.compute.manager [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-ff64a492-8e97-4c11-9207-bf56011d8a5d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG nova.compute.manager [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-ff64a492-8e97-4c11-9207-bf56011d8a5d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:52 user nova-compute[72019]: WARNING nova.compute.manager [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-ff64a492-8e97-4c11-9207-bf56011d8a5d for instance with vm_state building and task_state spawning.
Apr 14 13:13:52 user nova-compute[72019]: DEBUG nova.compute.manager [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-ff64a492-8e97-4c11-9207-bf56011d8a5d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG nova.compute.manager [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-ff64a492-8e97-4c11-9207-bf56011d8a5d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:52 user nova-compute[72019]: WARNING nova.compute.manager [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-ff64a492-8e97-4c11-9207-bf56011d8a5d for instance with vm_state building and task_state spawning.
Apr 14 13:13:52 user nova-compute[72019]: DEBUG nova.compute.manager [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-089a686b-763d-41df-b624-291933367593 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG nova.compute.manager [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-089a686b-763d-41df-b624-291933367593 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:52 user nova-compute[72019]: WARNING nova.compute.manager [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-089a686b-763d-41df-b624-291933367593 for instance with vm_state building and task_state spawning.
Apr 14 13:13:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-8e63fe4d-bc87-40cb-855e-ad82726ca39d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-8e63fe4d-bc87-40cb-855e-ad82726ca39d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:53 user nova-compute[72019]: WARNING nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-8e63fe4d-bc87-40cb-855e-ad82726ca39d for instance with vm_state building and task_state spawning.
Apr 14 13:13:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:53 user nova-compute[72019]: WARNING nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-97d7d320-4ac2-41af-86ca-c30f00808f33 for instance with vm_state building and task_state spawning.
Apr 14 13:13:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:53 user nova-compute[72019]: WARNING nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-97d7d320-4ac2-41af-86ca-c30f00808f33 for instance with vm_state building and task_state spawning.
Apr 14 13:13:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:53 user nova-compute[72019]: WARNING nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a for instance with vm_state building and task_state spawning.
Apr 14 13:13:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:53 user nova-compute[72019]: WARNING nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a for instance with vm_state building and task_state spawning.
Apr 14 13:13:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-8a4f2864-33fc-4666-bb51-bdd01bc07af4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-8a4f2864-33fc-4666-bb51-bdd01bc07af4 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:53 user nova-compute[72019]: WARNING nova.compute.manager [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-8a4f2864-33fc-4666-bb51-bdd01bc07af4 for instance with vm_state building and task_state spawning.
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-8761e94d-0cd8-4565-8c94-479685f68352 req-67909b56-b9d3-4950-918b-09c6d3fe171e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-c2904a0c-904d-4dc3-9ffc-aaa05e253319 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8761e94d-0cd8-4565-8c94-479685f68352 req-67909b56-b9d3-4950-918b-09c6d3fe171e service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8761e94d-0cd8-4565-8c94-479685f68352 req-67909b56-b9d3-4950-918b-09c6d3fe171e service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8761e94d-0cd8-4565-8c94-479685f68352 req-67909b56-b9d3-4950-918b-09c6d3fe171e service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-8761e94d-0cd8-4565-8c94-479685f68352 req-67909b56-b9d3-4950-918b-09c6d3fe171e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-c2904a0c-904d-4dc3-9ffc-aaa05e253319 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:54 user nova-compute[72019]: WARNING nova.compute.manager [req-8761e94d-0cd8-4565-8c94-479685f68352 req-67909b56-b9d3-4950-918b-09c6d3fe171e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-c2904a0c-904d-4dc3-9ffc-aaa05e253319 for instance with vm_state building and task_state spawning.
Apr 14 13:13:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478034.6568093, 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:54 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] VM Resumed (Lifecycle Event)
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.compute.manager [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:13:54 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Instance spawned successfully.
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:54 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478034.6591084, 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:54 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] VM Started (Lifecycle Event)
Apr 14 13:13:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:54 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:54 user nova-compute[72019]: INFO nova.compute.manager [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Took 15.27 seconds to spawn the instance on the hypervisor.
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.compute.manager [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-089a686b-763d-41df-b624-291933367593 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-089a686b-763d-41df-b624-291933367593 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:54 user nova-compute[72019]: WARNING nova.compute.manager [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-089a686b-763d-41df-b624-291933367593 for instance with vm_state building and task_state spawning.
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-96beb287-2181-4df4-b835-a9f071ace5df {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-96beb287-2181-4df4-b835-a9f071ace5df {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:54 user nova-compute[72019]: WARNING nova.compute.manager [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-96beb287-2181-4df4-b835-a9f071ace5df for instance with vm_state building and task_state spawning.
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-96beb287-2181-4df4-b835-a9f071ace5df {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-96beb287-2181-4df4-b835-a9f071ace5df {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:54 user nova-compute[72019]: WARNING nova.compute.manager [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-96beb287-2181-4df4-b835-a9f071ace5df for instance with vm_state building and task_state spawning.
Apr 14 13:13:54 user nova-compute[72019]: INFO nova.compute.manager [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Took 33.45 seconds to build instance.
Apr 14 13:13:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.688s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:55 user nova-compute[72019]: DEBUG nova.compute.manager [req-aba4f828-1433-47ac-951d-2501c87f35cb req-08f23577-9401-4ec5-9c93-9439b9aed0e3 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-8a4f2864-33fc-4666-bb51-bdd01bc07af4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aba4f828-1433-47ac-951d-2501c87f35cb req-08f23577-9401-4ec5-9c93-9439b9aed0e3 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aba4f828-1433-47ac-951d-2501c87f35cb req-08f23577-9401-4ec5-9c93-9439b9aed0e3 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aba4f828-1433-47ac-951d-2501c87f35cb req-08f23577-9401-4ec5-9c93-9439b9aed0e3 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:55 user nova-compute[72019]: DEBUG nova.compute.manager [req-aba4f828-1433-47ac-951d-2501c87f35cb req-08f23577-9401-4ec5-9c93-9439b9aed0e3 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-8a4f2864-33fc-4666-bb51-bdd01bc07af4 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:55 user nova-compute[72019]: WARNING nova.compute.manager [req-aba4f828-1433-47ac-951d-2501c87f35cb req-08f23577-9401-4ec5-9c93-9439b9aed0e3 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-8a4f2864-33fc-4666-bb51-bdd01bc07af4 for instance with vm_state building and task_state spawning.
Apr 14 13:13:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-c2904a0c-904d-4dc3-9ffc-aaa05e253319 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-c2904a0c-904d-4dc3-9ffc-aaa05e253319 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:56 user nova-compute[72019]: WARNING nova.compute.manager [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-c2904a0c-904d-4dc3-9ffc-aaa05e253319 for instance with vm_state building and task_state spawning.
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:56 user nova-compute[72019]: WARNING nova.compute.manager [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf for instance with vm_state building and task_state spawning.
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:13:56 user nova-compute[72019]: WARNING nova.compute.manager [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf for instance with vm_state building and task_state spawning.
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478036.243455, 7cf6ed7d-a98e-4984-967c-148e1537a118 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:56 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] VM Resumed (Lifecycle Event)
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:13:56 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Instance spawned successfully.
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:13:56 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478036.2472777, 7cf6ed7d-a98e-4984-967c-148e1537a118 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:13:56 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] VM Started (Lifecycle Event)
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:13:56 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:13:56 user nova-compute[72019]: INFO nova.compute.manager [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Took 16.58 seconds to spawn the instance on the hypervisor.
Apr 14 13:13:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:13:56 user nova-compute[72019]: INFO nova.compute.manager [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Took 36.93 seconds to build instance.
Apr 14 13:13:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.092s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:13:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:18 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:14:18 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:14:18 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:14:18 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:14:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:14:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:14:18 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-250af0ae-50d9-472e-a912-99bc04424367 req-6c8557bd-784b-401e-9911-39fdb3a73cff service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-changed-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-250af0ae-50d9-472e-a912-99bc04424367 req-6c8557bd-784b-401e-9911-39fdb3a73cff service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Refreshing instance network info cache due to event network-changed-e4b573e5-ec9a-4d14-974b-d8f2bf49c980. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-250af0ae-50d9-472e-a912-99bc04424367 req-6c8557bd-784b-401e-9911-39fdb3a73cff service nova] Acquiring lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Updating instance_info_cache with network_info: [{"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-250af0ae-50d9-472e-a912-99bc04424367 req-6c8557bd-784b-401e-9911-39fdb3a73cff service nova] Acquired lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG nova.network.neutron [req-250af0ae-50d9-472e-a912-99bc04424367 req-6c8557bd-784b-401e-9911-39fdb3a73cff service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Refreshing network info cache for port e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "62e10eb2-a042-4916-8b61-51f7dcd731dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG nova.objects.instance [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lazy-loading 'flavor' on Instance uuid 62e10eb2-a042-4916-8b61-51f7dcd731dd {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG nova.network.neutron [req-250af0ae-50d9-472e-a912-99bc04424367 req-6c8557bd-784b-401e-9911-39fdb3a73cff service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Updated VIF entry in instance network info cache for port e4b573e5-ec9a-4d14-974b-d8f2bf49c980. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG nova.network.neutron [req-250af0ae-50d9-472e-a912-99bc04424367 req-6c8557bd-784b-401e-9911-39fdb3a73cff service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Updating instance_info_cache with network_info: [{"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-250af0ae-50d9-472e-a912-99bc04424367 req-6c8557bd-784b-401e-9911-39fdb3a73cff service nova] Releasing lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "62e10eb2-a042-4916-8b61-51f7dcd731dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:20 user nova-compute[72019]: INFO nova.compute.manager [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Attaching volume 41f13b08-309d-4583-95cd-52c5551df3c1 to /dev/vdb
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG os_brick.utils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4aa35d-956f-48d3-8bfa-3bf651dcd1b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b7a149-7f70-439f-8ffd-fd1151f1c930]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d6e8e8-9465-4d00-8485-67c3f2d2a880]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a330dd-b174-43db-b1c1-5d517dbb5f59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:20 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[de960b1f-ea90-4054-9068-56cfadc8ca79]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG os_brick.utils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Updating existing volume attachment record: cd4778b3-fd84-488b-a46a-52a04161d2f4 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'flavor' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:22 user nova-compute[72019]: INFO nova.compute.manager [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Attaching volume 7f6a3c6d-43d9-4137-b0e1-699b36e9b999 to /dev/vdb
Apr 14 13:14:22 user nova-compute[72019]: DEBUG os_brick.utils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e28391d-eb2e-4e80-8b11-c93faa5aaf12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c22bdf-cf95-4cf2-b9a5-4a19890d4309]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f3a28a-feae-4444-a687-1803566c9a8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d77a812-4969-4c85-a7ce-32fdda98295f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:22 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[713885fc-fcd7-4460-ae64-402d8d8eba07]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG os_brick.utils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Updating existing volume attachment record: 0265212b-c673-4d9b-b759-f01b26ea7c0e {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:14:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:23 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:14:23 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7086MB free_disk=26.474273681640625GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 990b083b-744a-42cb-88f3-7ae16a5abed4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance c74c3463-6701-4150-9096-1775785e8e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance e058f6b1-e83b-49af-9ab3-a29b959f211f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:14:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:14:24 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:14:24 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:14:24 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:14:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:24 user nova-compute[72019]: INFO nova.compute.manager [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Rescuing
Apr 14 13:14:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:14:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquired lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:14:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:14:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Updating instance_info_cache with network_info: [{"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:14:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Releasing lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbdMuqHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:25 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:14:25 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:14:25 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eee633-1f3e-43a5-bb25-0965500d1f10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:14:25 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8ea8aa-902d-4e03-abbb-d9b7765e53fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1] added
Apr 14 13:14:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cce0fc-d87c-4eda-8b1b-0983b5b86992]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-858dfff5-4764-4f53-9022-1be4967538bd req-790ba4c5-5ef4-45ff-9caf-607fff827aca service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received event network-vif-unplugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-858dfff5-4764-4f53-9022-1be4967538bd req-790ba4c5-5ef4-45ff-9caf-607fff827aca service nova] Acquiring lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-858dfff5-4764-4f53-9022-1be4967538bd req-790ba4c5-5ef4-45ff-9caf-607fff827aca service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-858dfff5-4764-4f53-9022-1be4967538bd req-790ba4c5-5ef4-45ff-9caf-607fff827aca service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-858dfff5-4764-4f53-9022-1be4967538bd req-790ba4c5-5ef4-45ff-9caf-607fff827aca service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] No waiting events found dispatching network-vif-unplugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:14:25 user nova-compute[72019]: WARNING nova.compute.manager [req-858dfff5-4764-4f53-9022-1be4967538bd req-790ba4c5-5ef4-45ff-9caf-607fff827aca service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received unexpected event network-vif-unplugged-d5720602-747e-4fff-8334-2412fa184f73 for instance with vm_state active and task_state rescuing.
Apr 14 13:14:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd006be-cb18-4029-8087-557afeb1969e]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YbdMuqHz {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YbdMuqHz" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a48176-b79c-4262-969d-59de459c989c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YbdMuqHz'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cb71d8-a9ba-4566-a8bd-a253b6ecc610]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[536ef731-64cf-4a3a-8d30-af4e3b6ff9b9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da3ae90-eb4a-459b-9131-68437f225b34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1, portal: 172.16.0.220,3260]
Apr 14 13:14:25 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1, portal: 172.16.0.220,3260] successful.
Apr 14 13:14:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b988f5c-9bd7-46d2-bc6c-339619138246]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d10af7-d39c-4025-ba13-ceff86a0a658]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:25 user nova-compute[72019]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 (non-flash)
Apr 14 13:14:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b04bed6-2e8c-44e5-ac79-1e8aa58b441e]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbdMuqHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:25 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Instance destroyed successfully.
Apr 14 13:14:25 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Attempting rescue
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72019) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Instance directory exists: not creating {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 13:14:25 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Creating image(s)
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "/opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "/opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.objects.instance [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'trusted_certs' on Instance uuid cc4631eb-ae5b-4efa-9def-c0c45f56f40f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue" returned: 0 in 0.048s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.objects.instance [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'migration_context' on Instance uuid cc4631eb-ae5b-4efa-9def-c0c45f56f40f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Start _get_guest_xml network_info=[{"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "vif_mac": "fa:16:3e:d4:cc:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.objects.instance [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'resources' on Instance uuid cc4631eb-ae5b-4efa-9def-c0c45f56f40f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.objects.instance [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'numa_topology' on Instance uuid cc4631eb-ae5b-4efa-9def-c0c45f56f40f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:25 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:14:25 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:14:25 user nova-compute[72019]: DEBUG nova.objects.instance [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'vcpu_model' on Instance uuid cc4631eb-ae5b-4efa-9def-c0c45f56f40f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1383992809',display_name='tempest-ServerRescueNegativeTestJSON-server-1383992809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1383992809',id=4,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:12:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7c8c8f620334166a141ea65525ba2a0',ramdisk_id='',reservation_id='r-7zkpx5xm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1698214771',owner_user_name='tempest-ServerRescueNegativeTestJSON-1698214771-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:54Z,user_data=None,user_id='3948b7c643374bcdbeb34f0f2f790c3c',uuid=cc4631eb-ae5b-4efa-9def-c0c45f56f40f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "vif_mac": "fa:16:3e:d4:cc:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:14:26 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converting VIF {"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "vif_mac": "fa:16:3e:d4:cc:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:14:26 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:cc:9c,bridge_name='br-int',has_traffic_filtering=True,id=d5720602-747e-4fff-8334-2412fa184f73,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5720602-74') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:14:26 user nova-compute[72019]: DEBUG nova.objects.instance [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'pci_devices' on Instance uuid cc4631eb-ae5b-4efa-9def-c0c45f56f40f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:14:26 user nova-compute[72019]:   <uuid>cc4631eb-ae5b-4efa-9def-c0c45f56f40f</uuid>
Apr 14 13:14:26 user nova-compute[72019]:   <name>instance-00000004</name>
Apr 14 13:14:26 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:14:26 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:14:26 user nova-compute[72019]:   <metadata>
Apr 14 13:14:26 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:14:26 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:14:26 user nova-compute[72019]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1383992809</nova:name>
Apr 14 13:14:26 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:14:25</nova:creationTime>
Apr 14 13:14:26 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:14:26 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:14:26 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:14:26 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:14:26 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:14:26 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:14:26 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:14:26 user nova-compute[72019]:       <nova:owner>
Apr 14 13:14:26 user nova-compute[72019]:         <nova:user uuid="3948b7c643374bcdbeb34f0f2f790c3c">tempest-ServerRescueNegativeTestJSON-1698214771-project-member</nova:user>
Apr 14 13:14:26 user nova-compute[72019]:         <nova:project uuid="a7c8c8f620334166a141ea65525ba2a0">tempest-ServerRescueNegativeTestJSON-1698214771</nova:project>
Apr 14 13:14:26 user nova-compute[72019]:       </nova:owner>
Apr 14 13:14:26 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:14:26 user nova-compute[72019]:       <nova:ports>
Apr 14 13:14:26 user nova-compute[72019]:         <nova:port uuid="d5720602-747e-4fff-8334-2412fa184f73">
Apr 14 13:14:26 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 13:14:26 user nova-compute[72019]:         </nova:port>
Apr 14 13:14:26 user nova-compute[72019]:       </nova:ports>
Apr 14 13:14:26 user nova-compute[72019]:     </nova:instance>
Apr 14 13:14:26 user nova-compute[72019]:   </metadata>
Apr 14 13:14:26 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:14:26 user nova-compute[72019]:     <system>
Apr 14 13:14:26 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:14:26 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:14:26 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:14:26 user nova-compute[72019]:       <entry name="serial">cc4631eb-ae5b-4efa-9def-c0c45f56f40f</entry>
Apr 14 13:14:26 user nova-compute[72019]:       <entry name="uuid">cc4631eb-ae5b-4efa-9def-c0c45f56f40f</entry>
Apr 14 13:14:26 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:14:26 user nova-compute[72019]:     </system>
Apr 14 13:14:26 user nova-compute[72019]:   </sysinfo>
Apr 14 13:14:26 user nova-compute[72019]:   <os>
Apr 14 13:14:26 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:14:26 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:14:26 user nova-compute[72019]:   </os>
Apr 14 13:14:26 user nova-compute[72019]:   <features>
Apr 14 13:14:26 user nova-compute[72019]:     <acpi/>
Apr 14 13:14:26 user nova-compute[72019]:     <apic/>
Apr 14 13:14:26 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:14:26 user nova-compute[72019]:   </features>
Apr 14 13:14:26 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:14:26 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:14:26 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:14:26 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:14:26 user nova-compute[72019]:   </clock>
Apr 14 13:14:26 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:14:26 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:14:26 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:14:26 user nova-compute[72019]:   </cpu>
Apr 14 13:14:26 user nova-compute[72019]:   <devices>
Apr 14 13:14:26 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:14:26 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:14:26 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue"/>
Apr 14 13:14:26 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:14:26 user nova-compute[72019]:     </disk>
Apr 14 13:14:26 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:14:26 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:14:26 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk"/>
Apr 14 13:14:26 user nova-compute[72019]:       <target dev="vdb" bus="virtio"/>
Apr 14 13:14:26 user nova-compute[72019]:     </disk>
Apr 14 13:14:26 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:14:26 user nova-compute[72019]:       <mac address="fa:16:3e:d4:cc:9c"/>
Apr 14 13:14:26 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:14:26 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:14:26 user nova-compute[72019]:       <target dev="tapd5720602-74"/>
Apr 14 13:14:26 user nova-compute[72019]:     </interface>
Apr 14 13:14:26 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:14:26 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/console.log" append="off"/>
Apr 14 13:14:26 user nova-compute[72019]:     </serial>
Apr 14 13:14:26 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:14:26 user nova-compute[72019]:     <video>
Apr 14 13:14:26 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:14:26 user nova-compute[72019]:     </video>
Apr 14 13:14:26 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:14:26 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:14:26 user nova-compute[72019]:     </rng>
Apr 14 13:14:26 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:14:26 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:14:26 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:14:26 user nova-compute[72019]:     </memballoon>
Apr 14 13:14:26 user nova-compute[72019]:   </devices>
Apr 14 13:14:26 user nova-compute[72019]: </domain>
Apr 14 13:14:26 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:14:26 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Instance destroyed successfully.
Apr 14 13:14:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No VIF found with MAC fa:16:3e:d4:cc:9c, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:14:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:14:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23466663137613833', 'path': '/dev/sdh'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466663137613833', 'path': '/dev/sdh'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:14:26 user nova-compute[72019]: DEBUG nova.objects.instance [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lazy-loading 'flavor' on Instance uuid 62e10eb2-a042-4916-8b61-51f7dcd731dd {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:14:26 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:14:26 user nova-compute[72019]:   <source dev="/dev/sdh"/>
Apr 14 13:14:26 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:14:26 user nova-compute[72019]:   <serial>41f13b08-309d-4583-95cd-52c5551df3c1</serial>
Apr 14 13:14:26 user nova-compute[72019]: </disk>
Apr 14 13:14:26 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG nova.compute.manager [req-ce4c0fe3-e1bd-4841-be89-de1f79771b7d req-189a22f6-f08e-4d37-8727-116f0958dd87 service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received event network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ce4c0fe3-e1bd-4841-be89-de1f79771b7d req-189a22f6-f08e-4d37-8727-116f0958dd87 service nova] Acquiring lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ce4c0fe3-e1bd-4841-be89-de1f79771b7d req-189a22f6-f08e-4d37-8727-116f0958dd87 service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ce4c0fe3-e1bd-4841-be89-de1f79771b7d req-189a22f6-f08e-4d37-8727-116f0958dd87 service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG nova.compute.manager [req-ce4c0fe3-e1bd-4841-be89-de1f79771b7d req-189a22f6-f08e-4d37-8727-116f0958dd87 service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] No waiting events found dispatching network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:14:27 user nova-compute[72019]: WARNING nova.compute.manager [req-ce4c0fe3-e1bd-4841-be89-de1f79771b7d req-189a22f6-f08e-4d37-8727-116f0958dd87 service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received unexpected event network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 for instance with vm_state active and task_state rescuing.
Apr 14 13:14:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] No VIF found with MAC fa:16:3e:2d:13:e0, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WydfNSbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:27 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:14:27 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:14:27 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.400s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[169e351e-0514-44ba-a7ad-a6579cc7bbd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:14:27 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca79d638-d484-4307-91c1-42775bc0a197]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999] added
Apr 14 13:14:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8019efda-9ab6-44b0-82f8-b42c10d2270b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d010f0-9986-400b-83ce-1834214b70de]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WydfNSbX {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WydfNSbX" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c900a23-423c-4d8f-a268-5cd6f1ccbf68]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WydfNSbX'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c69d2f-d6be-4dcc-8d87-021d084478bb]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[60970477-c624-47dd-9c8f-a680f0c8653a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bb7e29-80db-479b-897d-655c211e6720]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260]
Apr 14 13:14:27 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260] successful.
Apr 14 13:14:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "62e10eb2-a042-4916-8b61-51f7dcd731dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:27 user nova-compute[72019]: INFO nova.compute.manager [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Terminating instance
Apr 14 13:14:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9789206-2631-441a-8fe3-ffdcfb939dba]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f7d56d-63e1-40b6-8c15-786c662ea60b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[13920105-0592-418d-9085-44d72febe7e5]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WydfNSbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:14:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-f592f3ee-fea4-4adb-862c-90f2d760e8dd req-8fee21cc-b13d-4ad2-b6d9-11b2f043809f service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Received event network-vif-unplugged-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f592f3ee-fea4-4adb-862c-90f2d760e8dd req-8fee21cc-b13d-4ad2-b6d9-11b2f043809f service nova] Acquiring lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f592f3ee-fea4-4adb-862c-90f2d760e8dd req-8fee21cc-b13d-4ad2-b6d9-11b2f043809f service nova] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f592f3ee-fea4-4adb-862c-90f2d760e8dd req-8fee21cc-b13d-4ad2-b6d9-11b2f043809f service nova] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-f592f3ee-fea4-4adb-862c-90f2d760e8dd req-8fee21cc-b13d-4ad2-b6d9-11b2f043809f service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] No waiting events found dispatching network-vif-unplugged-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-f592f3ee-fea4-4adb-862c-90f2d760e8dd req-8fee21cc-b13d-4ad2-b6d9-11b2f043809f service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Received event network-vif-unplugged-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:14:28 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Instance destroyed successfully.
Apr 14 13:14:28 user nova-compute[72019]: DEBUG nova.objects.instance [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lazy-loading 'resources' on Instance uuid 62e10eb2-a042-4916-8b61-51f7dcd731dd {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1108872439',display_name='tempest-DeleteServersTestJSON-server-1108872439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1108872439',id=1,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:12:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50d534e4c1cd4abb9204ce53e9a2a7b3',ramdisk_id='',reservation_id='r-7omwe66v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1521801319',owner_user_name='tempest-DeleteServersTestJSON-1521801319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:12:43Z,user_data=None,user_id='152f7a419a524915a216130426b32ea4',uuid=62e10eb2-a042-4916-8b61-51f7dcd731dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "address": "fa:16:3e:2d:13:e0", "network": {"id": "69762a08-01c9-4ee5-9118-3824b54739c4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721534193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d534e4c1cd4abb9204ce53e9a2a7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2255403b-5b", "ovs_interfaceid": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Converting VIF {"id": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "address": "fa:16:3e:2d:13:e0", "network": {"id": "69762a08-01c9-4ee5-9118-3824b54739c4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721534193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d534e4c1cd4abb9204ce53e9a2a7b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2255403b-5b", "ovs_interfaceid": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:13:e0,bridge_name='br-int',has_traffic_filtering=True,id=2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74,network=Network(69762a08-01c9-4ee5-9118-3824b54739c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2255403b-5b') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG os_vif [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:13:e0,bridge_name='br-int',has_traffic_filtering=True,id=2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74,network=Network(69762a08-01c9-4ee5-9118-3824b54739c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2255403b-5b') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2255403b-5b, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:28 user nova-compute[72019]: INFO os_vif [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:13:e0,bridge_name='br-int',has_traffic_filtering=True,id=2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74,network=Network(69762a08-01c9-4ee5-9118-3824b54739c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2255403b-5b')
Apr 14 13:14:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbdMuqHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:28 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:14:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23730383937383031', 'path': '/dev/sdi'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730383937383031', 'path': '/dev/sdi'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.288s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:28 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'flavor' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7694d861-47b3-47e9-84d7-1f76df3ebe34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:14:29 user nova-compute[72019]: No targets found.
Apr 14 13:14:29 user nova-compute[72019]: iSNS:
Apr 14 13:14:29 user nova-compute[72019]: No targets found.
Apr 14 13:14:29 user nova-compute[72019]: STATIC:
Apr 14 13:14:29 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5
Apr 14 13:14:29 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:29 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:29 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6
Apr 14 13:14:29 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:29 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:29 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21
Apr 14 13:14:29 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:29 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:29 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160
Apr 14 13:14:29 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:29 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:29 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc
Apr 14 13:14:29 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:29 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:29 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1
Apr 14 13:14:29 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:29 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:29 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:14:29 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:29 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:29 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1
Apr 14 13:14:29 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:29 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:29 user nova-compute[72019]: FIRMWARE:
Apr 14 13:14:29 user nova-compute[72019]: No targets found.
Apr 14 13:14:29 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:14:29 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:14:29 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:14:29 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:14:29 user nova-compute[72019]:   <source dev="/dev/sdi"/>
Apr 14 13:14:29 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:14:29 user nova-compute[72019]:   <serial>7f6a3c6d-43d9-4137-b0e1-699b36e9b999</serial>
Apr 14 13:14:29 user nova-compute[72019]: </disk>
Apr 14 13:14:29 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[77380499-44a8-4adc-affd-1d419b68e7fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d10c5b5-50ef-4dc3-8229-a8baa5342e35]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:29 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:29 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:29 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:29 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:29 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:29 user nova-compute[72019]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 (non-flash)
Apr 14 13:14:29 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:29 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:29 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:29 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:29 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:29 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:29 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:29 user nova-compute[72019]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 (non-flash)
Apr 14 13:14:29 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:29 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74901c04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1'): ({'sdh'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Removing single pathed devices sdh {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9182d2bf-2639-40c7-ac1a-ad9487bedd05]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bca0dd-64a7-4006-9acd-8a874632f998]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Flushing IO for device /dev/sdh {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32e7464-f81c-4134-9efb-c59749376e38]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[983eccd2-5593-4c94-ac6c-f9fd749142fd]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] SCSI volumes sdh have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[365ec07c-65e2-4a91-9c2c-197ddab97d0a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb8f715-cba2-4e41-8eaf-9d116cd1062b]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1, portal: 172.16.0.220,3260]
Apr 14 13:14:29 user nova-compute[72019]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1, portal: 172.16.0.220,3260] successful.
Apr 14 13:14:29 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f13b08-309d-4583-95cd-52c5551df3c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c860bd7a-9c80-4235-a8a8-611e4719d398]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] <== disconnect_volume: return (622ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:14:29 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Deleting instance files /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd_del
Apr 14 13:14:29 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Deletion of /opt/stack/data/nova/instances/62e10eb2-a042-4916-8b61-51f7dcd731dd_del complete
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72019) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 14 13:14:29 user nova-compute[72019]: INFO nova.virt.libvirt.host [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] UEFI support detected
Apr 14 13:14:29 user nova-compute[72019]: INFO nova.compute.manager [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Took 1.53 seconds to destroy the instance on the hypervisor.
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] No VIF found with MAC fa:16:3e:23:7a:d0, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received event network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] Acquiring lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] No waiting events found dispatching network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:14:29 user nova-compute[72019]: WARNING nova.compute.manager [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received unexpected event network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 for instance with vm_state active and task_state rescuing.
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received event network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] Acquiring lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] No waiting events found dispatching network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:14:29 user nova-compute[72019]: WARNING nova.compute.manager [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received unexpected event network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 for instance with vm_state active and task_state rescuing.
Apr 14 13:14:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.872s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for cc4631eb-ae5b-4efa-9def-c0c45f56f40f due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478069.9694614, cc4631eb-ae5b-4efa-9def-c0c45f56f40f => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:14:29 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] VM Resumed (Lifecycle Event)
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.compute.manager [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:14:29 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:14:30 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 13:14:30 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478069.9727702, cc4631eb-ae5b-4efa-9def-c0c45f56f40f => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:14:30 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] VM Started (Lifecycle Event)
Apr 14 13:14:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:14:30 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 13:14:30 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-c751fb6d-67f7-4a00-8f4b-09b9f8d2fb34 req-63516b36-5303-4f79-9556-cc88f647dfcf service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Received event network-vif-plugged-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c751fb6d-67f7-4a00-8f4b-09b9f8d2fb34 req-63516b36-5303-4f79-9556-cc88f647dfcf service nova] Acquiring lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c751fb6d-67f7-4a00-8f4b-09b9f8d2fb34 req-63516b36-5303-4f79-9556-cc88f647dfcf service nova] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c751fb6d-67f7-4a00-8f4b-09b9f8d2fb34 req-63516b36-5303-4f79-9556-cc88f647dfcf service nova] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-c751fb6d-67f7-4a00-8f4b-09b9f8d2fb34 req-63516b36-5303-4f79-9556-cc88f647dfcf service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] No waiting events found dispatching network-vif-plugged-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:14:30 user nova-compute[72019]: WARNING nova.compute.manager [req-c751fb6d-67f7-4a00-8f4b-09b9f8d2fb34 req-63516b36-5303-4f79-9556-cc88f647dfcf service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Received unexpected event network-vif-plugged-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 for instance with vm_state active and task_state deleting.
Apr 14 13:14:30 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Took 0.99 seconds to deallocate network for instance.
Apr 14 13:14:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2c523a32-7e09-4f43-a8f0-0c62e1b99d2a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2c523a32-7e09-4f43-a8f0-0c62e1b99d2a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-2c523a32-7e09-4f43-a8f0-0c62e1b99d2a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-5d08396a-3230-41b3-a261-3ee6be755346 req-3c046714-d9af-4826-b490-25af1e03285a service nova] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Received event network-vif-deleted-2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-2c523a32-7e09-4f43-a8f0-0c62e1b99d2a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72019) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG nova.objects.instance [None req-2c523a32-7e09-4f43-a8f0-0c62e1b99d2a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'flavor' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:31 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Instance destroyed successfully.
Apr 14 13:14:31 user nova-compute[72019]: DEBUG nova.compute.manager [None req-2c523a32-7e09-4f43-a8f0-0c62e1b99d2a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:14:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2c523a32-7e09-4f43-a8f0-0c62e1b99d2a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.963s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:31 user nova-compute[72019]: INFO nova.compute.manager [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Took 0.98 seconds to detach 1 volumes for instance.
Apr 14 13:14:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:31 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:14:31 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:14:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:31 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Deleted allocations for instance 62e10eb2-a042-4916-8b61-51f7dcd731dd
Apr 14 13:14:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "62e10eb2-a042-4916-8b61-51f7dcd731dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.160s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-b09760ea-0ef6-492b-8056-5ab27513554b req-4dad06b1-cbc3-4c2e-8754-56a25a030486 service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Received event network-changed-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-b09760ea-0ef6-492b-8056-5ab27513554b req-4dad06b1-cbc3-4c2e-8754-56a25a030486 service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Refreshing instance network info cache due to event network-changed-5fab05b1-9e56-4f0d-84e0-22573efdb2c4. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b09760ea-0ef6-492b-8056-5ab27513554b req-4dad06b1-cbc3-4c2e-8754-56a25a030486 service nova] Acquiring lock "refresh_cache-c34d24a3-a632-4f05-b6fb-dc3562dc93d6" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b09760ea-0ef6-492b-8056-5ab27513554b req-4dad06b1-cbc3-4c2e-8754-56a25a030486 service nova] Acquired lock "refresh_cache-c34d24a3-a632-4f05-b6fb-dc3562dc93d6" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG nova.network.neutron [req-b09760ea-0ef6-492b-8056-5ab27513554b req-4dad06b1-cbc3-4c2e-8754-56a25a030486 service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Refreshing network info cache for port 5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-vif-unplugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] No waiting events found dispatching network-vif-unplugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:14:32 user nova-compute[72019]: WARNING nova.compute.manager [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received unexpected event network-vif-unplugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance with vm_state stopped and task_state None.
Apr 14 13:14:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] No waiting events found dispatching network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:14:32 user nova-compute[72019]: WARNING nova.compute.manager [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received unexpected event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance with vm_state stopped and task_state None.
Apr 14 13:14:32 user nova-compute[72019]: DEBUG nova.network.neutron [req-b09760ea-0ef6-492b-8056-5ab27513554b req-4dad06b1-cbc3-4c2e-8754-56a25a030486 service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Updated VIF entry in instance network info cache for port 5fab05b1-9e56-4f0d-84e0-22573efdb2c4. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG nova.network.neutron [req-b09760ea-0ef6-492b-8056-5ab27513554b req-4dad06b1-cbc3-4c2e-8754-56a25a030486 service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Updating instance_info_cache with network_info: [{"id": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "address": "fa:16:3e:52:d9:41", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab05b1-9e", "ovs_interfaceid": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:14:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b09760ea-0ef6-492b-8056-5ab27513554b req-4dad06b1-cbc3-4c2e-8754-56a25a030486 service nova] Releasing lock "refresh_cache-c34d24a3-a632-4f05-b6fb-dc3562dc93d6" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:14:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG nova.objects.instance [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'flavor' on Instance uuid c34d24a3-a632-4f05-b6fb-dc3562dc93d6 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:34 user nova-compute[72019]: INFO nova.compute.manager [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Attaching volume 49056810-6abe-48de-b4bd-71d9f5d45096 to /dev/vdb
Apr 14 13:14:34 user nova-compute[72019]: DEBUG os_brick.utils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6daf7e-8017-4c85-b231-5e28c4cff40d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[be71334b-10f2-4e94-91ed-4141917011ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4df5fb-a13c-4ca0-97fb-8d21d9ee27ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11c527d-687d-4f87-86e0-d4ecba859ff8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:34 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:14:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c851d57d-a7a8-47e6-ab8e-7dc4099b55f8]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG os_brick.utils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:34 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Updating existing volume attachment record: f4e436ea-394d-409b-948c-c16a6c816000 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:14:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEcyLTCw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:39 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:14:39 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:14:39 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4ba1ea-ebc9-4eac-81aa-dd01cc8763ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:14:39 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[384d8979-1e23-4b1b-a9d5-e7b6bece3fc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096] added
Apr 14 13:14:39 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4402c444-8093-432c-b589-1a68eb740c0c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[296c05c8-fbae-4d25-930f-292f993b1944]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XEcyLTCw {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XEcyLTCw" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d86af9-12f3-42ef-b33a-28cff1de201b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XEcyLTCw'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4020724-7e46-460c-b64a-b581990bb3c4]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[453e5a58-9bd2-4ff2-9e43-2f2cf7c18464]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:39 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:39 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:39 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:39 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:39 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:39 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:39 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:39 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:39 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:39 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:39 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:39 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:39 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:39 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cbfbbc-24d2-4eb3-a7b1-b793c46d5c1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096, portal: 172.16.0.220,3260]
Apr 14 13:14:39 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096, portal: 172.16.0.220,3260] successful.
Apr 14 13:14:39 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e4a384-a75a-4bf9-a8c8-d9ca3802ac98]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:40 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07e95b9-2648-491d-9fc0-f2174826aef8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:40 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:40 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:40 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:40 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:40 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:40 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:40 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:40 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:40 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:40 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:40 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:40 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:40 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:40 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:40 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:40 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:40 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:40 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:14:40 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:14:40 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:14:40 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:14:40 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:14:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:40 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e6e757-727a-4732-a9d3-05b5c294b6c6]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:40 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:14:40 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEcyLTCw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:14:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:14:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26563646431333136', 'path': '/dev/sdh'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563646431333136', 'path': '/dev/sdh'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:14:41 user nova-compute[72019]: DEBUG nova.objects.instance [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'flavor' on Instance uuid c34d24a3-a632-4f05-b6fb-dc3562dc93d6 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:14:41 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:14:41 user nova-compute[72019]:   <source dev="/dev/sdh"/>
Apr 14 13:14:41 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:14:41 user nova-compute[72019]:   <serial>49056810-6abe-48de-b4bd-71d9f5d45096</serial>
Apr 14 13:14:41 user nova-compute[72019]: </disk>
Apr 14 13:14:41 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:14:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No VIF found with MAC fa:16:3e:52:d9:41, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:14:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.926s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:43 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478068.6443698, 62e10eb2-a042-4916-8b61-51f7dcd731dd => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:14:43 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] VM Stopped (Lifecycle Event)
Apr 14 13:14:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-04c5ee68-a849-4f9b-ab31-fb7969b41a43 None None] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:14:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:44 user nova-compute[72019]: DEBUG nova.compute.manager [req-a3d7b694-180d-4f2a-b143-84423fdfa9bc req-12306bf2-d258-43c3-82a1-84853d438d90 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Received event network-changed-81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:44 user nova-compute[72019]: DEBUG nova.compute.manager [req-a3d7b694-180d-4f2a-b143-84423fdfa9bc req-12306bf2-d258-43c3-82a1-84853d438d90 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Refreshing instance network info cache due to event network-changed-81acf974-1e47-44a8-822c-3d47187e3ae5. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:14:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a3d7b694-180d-4f2a-b143-84423fdfa9bc req-12306bf2-d258-43c3-82a1-84853d438d90 service nova] Acquiring lock "refresh_cache-c74c3463-6701-4150-9096-1775785e8e2a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:14:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a3d7b694-180d-4f2a-b143-84423fdfa9bc req-12306bf2-d258-43c3-82a1-84853d438d90 service nova] Acquired lock "refresh_cache-c74c3463-6701-4150-9096-1775785e8e2a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:14:44 user nova-compute[72019]: DEBUG nova.network.neutron [req-a3d7b694-180d-4f2a-b143-84423fdfa9bc req-12306bf2-d258-43c3-82a1-84853d438d90 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Refreshing network info cache for port 81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:14:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:14:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:44 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:14:44 user nova-compute[72019]: INFO nova.compute.claims [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Claim successful on node user
Apr 14 13:14:44 user nova-compute[72019]: DEBUG nova.network.neutron [req-a3d7b694-180d-4f2a-b143-84423fdfa9bc req-12306bf2-d258-43c3-82a1-84853d438d90 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Updated VIF entry in instance network info cache for port 81acf974-1e47-44a8-822c-3d47187e3ae5. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:14:44 user nova-compute[72019]: DEBUG nova.network.neutron [req-a3d7b694-180d-4f2a-b143-84423fdfa9bc req-12306bf2-d258-43c3-82a1-84853d438d90 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Updating instance_info_cache with network_info: [{"id": "81acf974-1e47-44a8-822c-3d47187e3ae5", "address": "fa:16:3e:86:67:71", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81acf974-1e", "ovs_interfaceid": "81acf974-1e47-44a8-822c-3d47187e3ae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a3d7b694-180d-4f2a-b143-84423fdfa9bc req-12306bf2-d258-43c3-82a1-84853d438d90 service nova] Releasing lock "refresh_cache-c74c3463-6701-4150-9096-1775785e8e2a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG nova.network.neutron [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:14:45 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:14:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG nova.policy [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:14:45 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Creating image(s)
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "/opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "/opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "/opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.144s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk 1073741824" returned: 0 in 0.047s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Cannot resize image /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG nova.objects.instance [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'migration_context' on Instance uuid 24179ea7-82e2-48fd-9aab-2e3bf7edb372 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478071.2716434, 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:14:46 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] VM Stopped (Lifecycle Event)
Apr 14 13:14:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Ensure instance console log exists: /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d7cb93ea-a472-4cdb-97ef-4c5d7c1171d3 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d7cb93ea-a472-4cdb-97ef-4c5d7c1171d3 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG nova.network.neutron [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Successfully created port: c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG nova.compute.manager [req-dc038592-7f30-4334-a13a-4aa463709cab req-5634710c-5abf-4881-8922-89b8832ad089 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Received event network-changed-c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG nova.compute.manager [req-dc038592-7f30-4334-a13a-4aa463709cab req-5634710c-5abf-4881-8922-89b8832ad089 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Refreshing instance network info cache due to event network-changed-c32a1dd7-ca19-4b21-8e75-1581be1c0374. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dc038592-7f30-4334-a13a-4aa463709cab req-5634710c-5abf-4881-8922-89b8832ad089 service nova] Acquiring lock "refresh_cache-f9b4e51c-b24a-4025-8be1-4294d06c18ff" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dc038592-7f30-4334-a13a-4aa463709cab req-5634710c-5abf-4881-8922-89b8832ad089 service nova] Acquired lock "refresh_cache-f9b4e51c-b24a-4025-8be1-4294d06c18ff" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG nova.network.neutron [req-dc038592-7f30-4334-a13a-4aa463709cab req-5634710c-5abf-4881-8922-89b8832ad089 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Refreshing network info cache for port c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "e058f6b1-e83b-49af-9ab3-a29b959f211f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "e058f6b1-e83b-49af-9ab3-a29b959f211f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:46 user nova-compute[72019]: INFO nova.compute.manager [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Terminating instance
Apr 14 13:14:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "c74c3463-6701-4150-9096-1775785e8e2a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "c74c3463-6701-4150-9096-1775785e8e2a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-17e3f127-7eb6-41b2-96b2-c6308bec28c2 req-cf0c5731-6e1e-403c-bef0-d49bc7bf7b02 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Received event network-changed-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-17e3f127-7eb6-41b2-96b2-c6308bec28c2 req-cf0c5731-6e1e-403c-bef0-d49bc7bf7b02 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Refreshing instance network info cache due to event network-changed-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-17e3f127-7eb6-41b2-96b2-c6308bec28c2 req-cf0c5731-6e1e-403c-bef0-d49bc7bf7b02 service nova] Acquiring lock "refresh_cache-990b083b-744a-42cb-88f3-7ae16a5abed4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-17e3f127-7eb6-41b2-96b2-c6308bec28c2 req-cf0c5731-6e1e-403c-bef0-d49bc7bf7b02 service nova] Acquired lock "refresh_cache-990b083b-744a-42cb-88f3-7ae16a5abed4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.network.neutron [req-17e3f127-7eb6-41b2-96b2-c6308bec28c2 req-cf0c5731-6e1e-403c-bef0-d49bc7bf7b02 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Refreshing network info cache for port 932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.objects.instance [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lazy-loading 'flavor' on Instance uuid c74c3463-6701-4150-9096-1775785e8e2a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "c74c3463-6701-4150-9096-1775785e8e2a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:47 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Instance destroyed successfully.
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.objects.instance [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lazy-loading 'resources' on Instance uuid e058f6b1-e83b-49af-9ab3-a29b959f211f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "990b083b-744a-42cb-88f3-7ae16a5abed4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2141644410',display_name='tempest-VolumesActionsTest-instance-2141644410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2141644410',id=8,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1c7d361867b4265bd4e1d13e9e66bc4',ramdisk_id='',reservation_id='r-mvx0x4bp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2125520108',owner_user_name='tempest-VolumesActionsTest-2125520108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:09Z,user_data=None,user_id='1c4166b50a7c49158acc8684eaee6041',uuid=e058f6b1-e83b-49af-9ab3-a29b959f211f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe327006-c497-4b3f-8e4a-74a407193cb4", "address": "fa:16:3e:f1:0c:e5", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe327006-c4", "ovs_interfaceid": "fe327006-c497-4b3f-8e4a-74a407193cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Converting VIF {"id": "fe327006-c497-4b3f-8e4a-74a407193cb4", "address": "fa:16:3e:f1:0c:e5", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe327006-c4", "ovs_interfaceid": "fe327006-c497-4b3f-8e4a-74a407193cb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:0c:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe327006-c497-4b3f-8e4a-74a407193cb4,network=Network(c6dfe7b8-e16e-4c31-93b7-9e358f72de7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe327006-c4') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG os_vif [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:0c:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe327006-c497-4b3f-8e4a-74a407193cb4,network=Network(c6dfe7b8-e16e-4c31-93b7-9e358f72de7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe327006-c4') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.objects.instance [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lazy-loading 'flavor' on Instance uuid 990b083b-744a-42cb-88f3-7ae16a5abed4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe327006-c4, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-98aa5445-b118-4c13-936f-4e34dc805b1f req-00104044-ae65-4c31-8760-af6f60f90b07 service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Received event network-vif-unplugged-fe327006-c497-4b3f-8e4a-74a407193cb4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-98aa5445-b118-4c13-936f-4e34dc805b1f req-00104044-ae65-4c31-8760-af6f60f90b07 service nova] Acquiring lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-98aa5445-b118-4c13-936f-4e34dc805b1f req-00104044-ae65-4c31-8760-af6f60f90b07 service nova] Lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-98aa5445-b118-4c13-936f-4e34dc805b1f req-00104044-ae65-4c31-8760-af6f60f90b07 service nova] Lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-98aa5445-b118-4c13-936f-4e34dc805b1f req-00104044-ae65-4c31-8760-af6f60f90b07 service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] No waiting events found dispatching network-vif-unplugged-fe327006-c497-4b3f-8e4a-74a407193cb4 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-98aa5445-b118-4c13-936f-4e34dc805b1f req-00104044-ae65-4c31-8760-af6f60f90b07 service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Received event network-vif-unplugged-fe327006-c497-4b3f-8e4a-74a407193cb4 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "c74c3463-6701-4150-9096-1775785e8e2a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "c74c3463-6701-4150-9096-1775785e8e2a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:47 user nova-compute[72019]: INFO nova.compute.manager [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Attaching volume 3c84a2c9-e024-4e22-bf1f-3c65264d17a0 to /dev/vdb
Apr 14 13:14:47 user nova-compute[72019]: INFO os_vif [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:0c:e5,bridge_name='br-int',has_traffic_filtering=True,id=fe327006-c497-4b3f-8e4a-74a407193cb4,network=Network(c6dfe7b8-e16e-4c31-93b7-9e358f72de7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe327006-c4')
Apr 14 13:14:47 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Deleting instance files /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f_del
Apr 14 13:14:47 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Deletion of /opt/stack/data/nova/instances/e058f6b1-e83b-49af-9ab3-a29b959f211f_del complete
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:47 user nova-compute[72019]: INFO nova.compute.manager [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Took 0.76 seconds to destroy the instance on the hypervisor.
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG os_brick.utils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b9484d-b949-414c-9b6c-220ee20a90e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0ffb41-852a-4553-8b10-5c08dc844b35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[611dfc0e-4eab-4ee6-92c5-70ce45ce2195]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed1b3ca-12b6-4d2b-8e01-b4b09a6c4b2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:47 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92c625d-d406-4ff8-b1bf-baef1116c00a]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG os_brick.utils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Updating existing volume attachment record: 675d39f5-f588-40df-a01a-e9bcbc71fed4 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "990b083b-744a-42cb-88f3-7ae16a5abed4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:47 user nova-compute[72019]: INFO nova.compute.manager [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Attaching volume 3ddfd1c1-8f03-4f07-a754-304e70750e92 to /dev/vdb
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Successfully updated port: c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "refresh_cache-24179ea7-82e2-48fd-9aab-2e3bf7edb372" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquired lock "refresh_cache-24179ea7-82e2-48fd-9aab-2e3bf7edb372" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG os_brick.utils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.network.neutron [req-dc038592-7f30-4334-a13a-4aa463709cab req-5634710c-5abf-4881-8922-89b8832ad089 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Updated VIF entry in instance network info cache for port c32a1dd7-ca19-4b21-8e75-1581be1c0374. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.network.neutron [req-dc038592-7f30-4334-a13a-4aa463709cab req-5634710c-5abf-4881-8922-89b8832ad089 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Updating instance_info_cache with network_info: [{"id": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "address": "fa:16:3e:8c:5b:a5", "network": {"id": "8ce2e5cd-683e-4a90-9604-35890337ad09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-140415757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14f43e2f82342ddbdb5c4ceedc96936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a1dd7-ca", "ovs_interfaceid": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b349bcb-3a20-4237-8359-fccd0b8133b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dc038592-7f30-4334-a13a-4aa463709cab req-5634710c-5abf-4881-8922-89b8832ad089 service nova] Releasing lock "refresh_cache-f9b4e51c-b24a-4025-8be1-4294d06c18ff" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7358eb38-4d02-44e4-808d-55f078252a71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f892d55f-c9b9-43bb-aa6a-2e4a88688298]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f3d46f-bd1a-4c97-a99d-c458ee629498]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:47 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:14:47 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7872ca48-56a9-4a0e-98f4-b41e2f4b96ee]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG os_brick.utils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:47 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Updating existing volume attachment record: eb3946ed-2313-465d-a008-74adb689f021 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.network.neutron [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Updating instance_info_cache with network_info: [{"id": "c1984923-9c3a-400f-9e54-c4bc6b476074", "address": "fa:16:3e:26:5c:9a", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1984923-9c", "ovs_interfaceid": "c1984923-9c3a-400f-9e54-c4bc6b476074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Releasing lock "refresh_cache-24179ea7-82e2-48fd-9aab-2e3bf7edb372" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Instance network_info: |[{"id": "c1984923-9c3a-400f-9e54-c4bc6b476074", "address": "fa:16:3e:26:5c:9a", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1984923-9c", "ovs_interfaceid": "c1984923-9c3a-400f-9e54-c4bc6b476074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Start _get_guest_xml network_info=[{"id": "c1984923-9c3a-400f-9e54-c4bc6b476074", "address": "fa:16:3e:26:5c:9a", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1984923-9c", "ovs_interfaceid": "c1984923-9c3a-400f-9e54-c4bc6b476074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:14:48 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:14:48 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-635632514',display_name='tempest-AttachVolumeNegativeTest-server-635632514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-635632514',id=14,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/584IerZHYCW7Vrg1ZzlqOqLu8QT1OK09DsRuAHJ64sJni4ga/8sJVg77u23BliovVhhCBDFa6Zfrn5rTMjHEinlCzk/yYvmpWxEgtFvbxo0L3max/KhBCJVMGH9tZ2g==',key_name='tempest-keypair-713053172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6833a69217034c4d85ff10bf8aa2fa5c',ramdisk_id='',reservation_id='r-6wi0dhpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-893959880',owner_user_name='tempest-AttachVolumeNegativeTest-893959880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65812c6559684eddbdde33cd64ca1fba',uuid=24179ea7-82e2-48fd-9aab-2e3bf7edb372,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1984923-9c3a-400f-9e54-c4bc6b476074", "address": "fa:16:3e:26:5c:9a", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1984923-9c", "ovs_interfaceid": "c1984923-9c3a-400f-9e54-c4bc6b476074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converting VIF {"id": "c1984923-9c3a-400f-9e54-c4bc6b476074", "address": "fa:16:3e:26:5c:9a", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1984923-9c", "ovs_interfaceid": "c1984923-9c3a-400f-9e54-c4bc6b476074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:5c:9a,bridge_name='br-int',has_traffic_filtering=True,id=c1984923-9c3a-400f-9e54-c4bc6b476074,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1984923-9c') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.objects.instance [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'pci_devices' on Instance uuid 24179ea7-82e2-48fd-9aab-2e3bf7edb372 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-17e3f127-7eb6-41b2-96b2-c6308bec28c2 req-cf0c5731-6e1e-403c-bef0-d49bc7bf7b02 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Updated VIF entry in instance network info cache for port 932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-17e3f127-7eb6-41b2-96b2-c6308bec28c2 req-cf0c5731-6e1e-403c-bef0-d49bc7bf7b02 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Updating instance_info_cache with network_info: [{"id": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "address": "fa:16:3e:d5:ed:2c", "network": {"id": "a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972", "bridge": "br-int", "label": "tempest-TestVolumeSwap-715659165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dfe057a9f742ceb908883f28463a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932d0b4b-da", "ovs_interfaceid": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:14:48 user nova-compute[72019]:   <uuid>24179ea7-82e2-48fd-9aab-2e3bf7edb372</uuid>
Apr 14 13:14:48 user nova-compute[72019]:   <name>instance-0000000e</name>
Apr 14 13:14:48 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:14:48 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:14:48 user nova-compute[72019]:   <metadata>
Apr 14 13:14:48 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:14:48 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:14:48 user nova-compute[72019]:       <nova:name>tempest-AttachVolumeNegativeTest-server-635632514</nova:name>
Apr 14 13:14:48 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:14:48</nova:creationTime>
Apr 14 13:14:48 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:14:48 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:14:48 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:14:48 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:14:48 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:14:48 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:14:48 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:14:48 user nova-compute[72019]:       <nova:owner>
Apr 14 13:14:48 user nova-compute[72019]:         <nova:user uuid="65812c6559684eddbdde33cd64ca1fba">tempest-AttachVolumeNegativeTest-893959880-project-member</nova:user>
Apr 14 13:14:48 user nova-compute[72019]:         <nova:project uuid="6833a69217034c4d85ff10bf8aa2fa5c">tempest-AttachVolumeNegativeTest-893959880</nova:project>
Apr 14 13:14:48 user nova-compute[72019]:       </nova:owner>
Apr 14 13:14:48 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:14:48 user nova-compute[72019]:       <nova:ports>
Apr 14 13:14:48 user nova-compute[72019]:         <nova:port uuid="c1984923-9c3a-400f-9e54-c4bc6b476074">
Apr 14 13:14:48 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 13:14:48 user nova-compute[72019]:         </nova:port>
Apr 14 13:14:48 user nova-compute[72019]:       </nova:ports>
Apr 14 13:14:48 user nova-compute[72019]:     </nova:instance>
Apr 14 13:14:48 user nova-compute[72019]:   </metadata>
Apr 14 13:14:48 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:14:48 user nova-compute[72019]:     <system>
Apr 14 13:14:48 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:14:48 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:14:48 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:14:48 user nova-compute[72019]:       <entry name="serial">24179ea7-82e2-48fd-9aab-2e3bf7edb372</entry>
Apr 14 13:14:48 user nova-compute[72019]:       <entry name="uuid">24179ea7-82e2-48fd-9aab-2e3bf7edb372</entry>
Apr 14 13:14:48 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:14:48 user nova-compute[72019]:     </system>
Apr 14 13:14:48 user nova-compute[72019]:   </sysinfo>
Apr 14 13:14:48 user nova-compute[72019]:   <os>
Apr 14 13:14:48 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:14:48 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:14:48 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:14:48 user nova-compute[72019]:   </os>
Apr 14 13:14:48 user nova-compute[72019]:   <features>
Apr 14 13:14:48 user nova-compute[72019]:     <acpi/>
Apr 14 13:14:48 user nova-compute[72019]:     <apic/>
Apr 14 13:14:48 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:14:48 user nova-compute[72019]:   </features>
Apr 14 13:14:48 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:14:48 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:14:48 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:14:48 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:14:48 user nova-compute[72019]:   </clock>
Apr 14 13:14:48 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:14:48 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:14:48 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:14:48 user nova-compute[72019]:   </cpu>
Apr 14 13:14:48 user nova-compute[72019]:   <devices>
Apr 14 13:14:48 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:14:48 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:14:48 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk"/>
Apr 14 13:14:48 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:14:48 user nova-compute[72019]:     </disk>
Apr 14 13:14:48 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:14:48 user nova-compute[72019]:       <mac address="fa:16:3e:26:5c:9a"/>
Apr 14 13:14:48 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:14:48 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:14:48 user nova-compute[72019]:       <target dev="tapc1984923-9c"/>
Apr 14 13:14:48 user nova-compute[72019]:     </interface>
Apr 14 13:14:48 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:14:48 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/console.log" append="off"/>
Apr 14 13:14:48 user nova-compute[72019]:     </serial>
Apr 14 13:14:48 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:14:48 user nova-compute[72019]:     <video>
Apr 14 13:14:48 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:14:48 user nova-compute[72019]:     </video>
Apr 14 13:14:48 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:14:48 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:14:48 user nova-compute[72019]:     </rng>
Apr 14 13:14:48 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:14:48 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:14:48 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:14:48 user nova-compute[72019]:     </memballoon>
Apr 14 13:14:48 user nova-compute[72019]:   </devices>
Apr 14 13:14:48 user nova-compute[72019]: </domain>
Apr 14 13:14:48 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-635632514',display_name='tempest-AttachVolumeNegativeTest-server-635632514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-635632514',id=14,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/584IerZHYCW7Vrg1ZzlqOqLu8QT1OK09DsRuAHJ64sJni4ga/8sJVg77u23BliovVhhCBDFa6Zfrn5rTMjHEinlCzk/yYvmpWxEgtFvbxo0L3max/KhBCJVMGH9tZ2g==',key_name='tempest-keypair-713053172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6833a69217034c4d85ff10bf8aa2fa5c',ramdisk_id='',reservation_id='r-6wi0dhpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-893959880',owner_user_name='tempest-AttachVolumeNegativeTest-893959880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65812c6559684eddbdde33cd64ca1fba',uuid=24179ea7-82e2-48fd-9aab-2e3bf7edb372,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1984923-9c3a-400f-9e54-c4bc6b476074", "address": "fa:16:3e:26:5c:9a", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1984923-9c", "ovs_interfaceid": "c1984923-9c3a-400f-9e54-c4bc6b476074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converting VIF {"id": "c1984923-9c3a-400f-9e54-c4bc6b476074", "address": "fa:16:3e:26:5c:9a", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1984923-9c", "ovs_interfaceid": "c1984923-9c3a-400f-9e54-c4bc6b476074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:5c:9a,bridge_name='br-int',has_traffic_filtering=True,id=c1984923-9c3a-400f-9e54-c4bc6b476074,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1984923-9c') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG os_vif [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:5c:9a,bridge_name='br-int',has_traffic_filtering=True,id=c1984923-9c3a-400f-9e54-c4bc6b476074,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1984923-9c') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-17e3f127-7eb6-41b2-96b2-c6308bec28c2 req-cf0c5731-6e1e-403c-bef0-d49bc7bf7b02 service nova] Releasing lock "refresh_cache-990b083b-744a-42cb-88f3-7ae16a5abed4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.objects.instance [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lazy-loading 'flavor' on Instance uuid f9b4e51c-b24a-4025-8be1-4294d06c18ff {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1984923-9c, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1984923-9c, col_values=(('external_ids', {'iface-id': 'c1984923-9c3a-400f-9e54-c4bc6b476074', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:5c:9a', 'vm-uuid': '24179ea7-82e2-48fd-9aab-2e3bf7edb372'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:48 user nova-compute[72019]: INFO os_vif [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:5c:9a,bridge_name='br-int',has_traffic_filtering=True,id=c1984923-9c3a-400f-9e54-c4bc6b476074,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1984923-9c')
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No VIF found with MAC fa:16:3e:26:5c:9a, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:48 user nova-compute[72019]: INFO nova.compute.manager [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Attaching volume 6129a78c-9792-4a9b-b24f-bf4740cbc012 to /dev/sdc
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:14:48 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Took 1.12 seconds to deallocate network for instance.
Apr 14 13:14:48 user nova-compute[72019]: DEBUG os_brick.utils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c29490-a614-4685-90f7-24c5c039d4dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[211373b2-a15c-496a-9ad4-91a13fe8fbea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3421cf-6307-451c-b0b9-4a3b283c7cdd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ff9cda-8254-48eb-ae11-e0e993cb1570]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:48 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:14:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6392164-7a90-461b-93cb-001fb165f5f4]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG os_brick.utils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:48 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Updating existing volume attachment record: e917dac6-e71b-41de-b256-dd5dc39c4772 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-32fc33e2-f3d7-4ef7-a69e-35f37e315703 req-2ec7381a-78c3-4390-bce9-fc786afb0d8b service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Received event network-vif-deleted-fe327006-c497-4b3f-8e4a-74a407193cb4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:49 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Deleted allocations for instance e058f6b1-e83b-49af-9ab3-a29b959f211f
Apr 14 13:14:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "e058f6b1-e83b-49af-9ab3-a29b959f211f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.638s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Received event network-changed-c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Refreshing instance network info cache due to event network-changed-c1984923-9c3a-400f-9e54-c4bc6b476074. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] Acquiring lock "refresh_cache-24179ea7-82e2-48fd-9aab-2e3bf7edb372" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] Acquired lock "refresh_cache-24179ea7-82e2-48fd-9aab-2e3bf7edb372" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG nova.network.neutron [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Refreshing network info cache for port c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:50 user nova-compute[72019]: DEBUG nova.network.neutron [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Updated VIF entry in instance network info cache for port c1984923-9c3a-400f-9e54-c4bc6b476074. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:14:50 user nova-compute[72019]: DEBUG nova.network.neutron [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Updating instance_info_cache with network_info: [{"id": "c1984923-9c3a-400f-9e54-c4bc6b476074", "address": "fa:16:3e:26:5c:9a", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1984923-9c", "ovs_interfaceid": "c1984923-9c3a-400f-9e54-c4bc6b476074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:14:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] Releasing lock "refresh_cache-24179ea7-82e2-48fd-9aab-2e3bf7edb372" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:14:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Received event network-vif-plugged-fe327006-c497-4b3f-8e4a-74a407193cb4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] Acquiring lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] Lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] Lock "e058f6b1-e83b-49af-9ab3-a29b959f211f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] No waiting events found dispatching network-vif-plugged-fe327006-c497-4b3f-8e4a-74a407193cb4 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:14:50 user nova-compute[72019]: WARNING nova.compute.manager [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Received unexpected event network-vif-plugged-fe327006-c497-4b3f-8e4a-74a407193cb4 for instance with vm_state deleted and task_state None.
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Received event network-vif-plugged-c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] Acquiring lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] Lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] Lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] No waiting events found dispatching network-vif-plugged-c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:14:51 user nova-compute[72019]: WARNING nova.compute.manager [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Received unexpected event network-vif-plugged-c1984923-9c3a-400f-9e54-c4bc6b476074 for instance with vm_state building and task_state spawning.
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Received event network-vif-plugged-c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] Acquiring lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] Lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] Lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] No waiting events found dispatching network-vif-plugged-c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:14:51 user nova-compute[72019]: WARNING nova.compute.manager [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Received unexpected event network-vif-plugged-c1984923-9c3a-400f-9e54-c4bc6b476074 for instance with vm_state building and task_state spawning.
Apr 14 13:14:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478091.8513184, 24179ea7-82e2-48fd-9aab-2e3bf7edb372 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:14:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] VM Resumed (Lifecycle Event)
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:14:51 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Instance spawned successfully.
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:14:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478091.8531036, 24179ea7-82e2-48fd-9aab-2e3bf7edb372 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:14:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] VM Started (Lifecycle Event)
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:14:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:14:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:14:52 user nova-compute[72019]: INFO nova.compute.manager [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Took 6.39 seconds to spawn the instance on the hypervisor.
Apr 14 13:14:52 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:14:52 user nova-compute[72019]: INFO nova.compute.manager [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Took 7.22 seconds to build instance.
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.339s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwvDItlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:52 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:14:52 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:14:52 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bb5937-371d-4019-8fee-e4002969f80e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:14:52 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d15677c-986c-4e2a-ae46-42c6e087c671]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92] added
Apr 14 13:14:52 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf47a80e-4f0d-4862-8100-af1db24e7442]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a83439-2aef-49b1-b40b-bd1a4cee0ab0]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GwvDItlx {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GwvDItlx" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c225db58-f905-4aa1-8d13-ee1d15f488a1]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GwvDItlx'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4ec6f5-68b1-447c-94c9-daa72f4d01f3]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[95332249-b4bf-4186-b701-eb2c8b1429eb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11bae8a-8d52-4a1c-98a9-fae0f8c83b4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260]
Apr 14 13:14:52 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260] successful.
Apr 14 13:14:52 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5220dde-4812-4d98-833b-8bbf1f0aed56]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d684429-caef-4b80-a0f8-1f2b7007b1aa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:52 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:52 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b448d507-9d2c-4fc1-8c84-9deb502ed880]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:14:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwvDItlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:14:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-2c2db566-2985-4014-a905-1839a938b3fc req-6bffa2f6-47cd-447b-a687-da3fdd15c1ca service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received event network-changed-0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-2c2db566-2985-4014-a905-1839a938b3fc req-6bffa2f6-47cd-447b-a687-da3fdd15c1ca service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Refreshing instance network info cache due to event network-changed-0946e034-1e6c-42d6-a8e2-1b24fabc000c. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:14:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2c2db566-2985-4014-a905-1839a938b3fc req-6bffa2f6-47cd-447b-a687-da3fdd15c1ca service nova] Acquiring lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:14:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2c2db566-2985-4014-a905-1839a938b3fc req-6bffa2f6-47cd-447b-a687-da3fdd15c1ca service nova] Acquired lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:14:53 user nova-compute[72019]: DEBUG nova.network.neutron [req-2c2db566-2985-4014-a905-1839a938b3fc req-6bffa2f6-47cd-447b-a687-da3fdd15c1ca service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Refreshing network info cache for port 0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:14:53 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:14:53 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23563623261313939', 'path': '/dev/sdj'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563623261313939', 'path': '/dev/sdj'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:14:53 user nova-compute[72019]: DEBUG nova.objects.instance [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lazy-loading 'flavor' on Instance uuid 990b083b-744a-42cb-88f3-7ae16a5abed4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:14:54 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:14:54 user nova-compute[72019]:   <source dev="/dev/sdj"/>
Apr 14 13:14:54 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:14:54 user nova-compute[72019]:   <serial>3ddfd1c1-8f03-4f07-a754-304e70750e92</serial>
Apr 14 13:14:54 user nova-compute[72019]: </disk>
Apr 14 13:14:54 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "interface-15df44a4-fc31-4dfa-870d-0dd1db47ccd7-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "interface-15df44a4-fc31-4dfa-870d-0dd1db47ccd7-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG nova.objects.instance [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lazy-loading 'flavor' on Instance uuid 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG nova.network.neutron [req-2c2db566-2985-4014-a905-1839a938b3fc req-6bffa2f6-47cd-447b-a687-da3fdd15c1ca service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Updated VIF entry in instance network info cache for port 0946e034-1e6c-42d6-a8e2-1b24fabc000c. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG nova.network.neutron [req-2c2db566-2985-4014-a905-1839a938b3fc req-6bffa2f6-47cd-447b-a687-da3fdd15c1ca service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Updating instance_info_cache with network_info: [{"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2c2db566-2985-4014-a905-1839a938b3fc req-6bffa2f6-47cd-447b-a687-da3fdd15c1ca service nova] Releasing lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG nova.objects.instance [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lazy-loading 'pci_requests' on Instance uuid 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG nova.network.neutron [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG nova.policy [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '016ee10024d2449c93d67e0b14f09f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a7e094618456381891d4532bb3cf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] No VIF found with MAC fa:16:3e:d5:ed:2c, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.954s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:54 user nova-compute[72019]: DEBUG nova.network.neutron [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Successfully created port: 86f24d4d-809a-47a3-9ca5-b45042e95ce8 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Acquiring lock "990b083b-744a-42cb-88f3-7ae16a5abed4" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSYInAGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:55 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:14:55 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:14:55 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.utils [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c9ae7-84c2-438c-a08b-b26b11dee1b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:14:55 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaefd613-6b0b-42c0-ab2e-55a797ec117a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea8cb78-5df1-41bf-af51-0bf9eaa311fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0] added
Apr 14 13:14:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd345e0b-a0bf-4cdf-9e34-7443cfa1b5c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff52604-c63d-4a21-b084-75cc70f64b70]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d538c6b-53e5-4da6-9bb9-c14713b09aeb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d9fe1d-a484-4b8a-8b44-6873252a6516]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc103b2-5abc-49f7-b478-81ed4858e8f0]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG nova.network.neutron [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Successfully updated port: 86f24d4d-809a-47a3-9ca5-b45042e95ce8 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LSYInAGc {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:55 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62347e9-d67f-406f-877d-6f9b44d13c62]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.utils [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LSYInAGc" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3e5a45-ebc9-43a1-86a9-e0df8c5001ff]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LSYInAGc'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquired lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG nova.network.neutron [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG nova.compute.manager [req-639181eb-abf5-4d9d-932b-e98f2fdc6df3 req-6e49bed0-6f07-46bf-9a41-c046f6670d42 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received event network-changed-86f24d4d-809a-47a3-9ca5-b45042e95ce8 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG nova.compute.manager [req-639181eb-abf5-4d9d-932b-e98f2fdc6df3 req-6e49bed0-6f07-46bf-9a41-c046f6670d42 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Refreshing instance network info cache due to event network-changed-86f24d4d-809a-47a3-9ca5-b45042e95ce8. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-639181eb-abf5-4d9d-932b-e98f2fdc6df3 req-6e49bed0-6f07-46bf-9a41-c046f6670d42 service nova] Acquiring lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5058436a-37f2-43bf-b958-2a6dfb5b2ff1]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64d1c26-54e0-4115-8e64-79cc88f68d3f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: INFO nova.compute.manager [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Swapping volume 3ddfd1c1-8f03-4f07-a754-304e70750e92 for 3bfe6502-3c9d-4714-a244-31792062ae86
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9599ea-b374-472e-a7fd-2ee66fadcdb8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0, portal: 172.16.0.220,3260]
Apr 14 13:14:55 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0, portal: 172.16.0.220,3260] successful.
Apr 14 13:14:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b7f1f1-ffce-481f-a19e-58bd89684fce]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa55deb-d64e-4da9-87d0-4d9f1f29d686]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:55 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.453s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:14:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd811c7d-b6d5-4076-a898-8ea707e3a160]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSYInAGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG nova.network.neutron [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Updating instance_info_cache with network_info: [{"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "address": "fa:16:3e:e8:50:59", "network": {"id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-39095167", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f24d4d-80", "ovs_interfaceid": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Releasing lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-639181eb-abf5-4d9d-932b-e98f2fdc6df3 req-6e49bed0-6f07-46bf-9a41-c046f6670d42 service nova] Acquired lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG nova.network.neutron [req-639181eb-abf5-4d9d-932b-e98f2fdc6df3 req-6e49bed0-6f07-46bf-9a41-c046f6670d42 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Refreshing network info cache for port 86f24d4d-809a-47a3-9ca5-b45042e95ce8 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1305382448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1305382448',id=10,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4duIqCv7vEVSja8IqrS2m8nOyBfEtm9GNp6oVWYmKH8ODAqPLRXepqVchMI9s9qHWy17HwfyhVBB5y+o51mGHAALloM+mnGYFQ/OSrPtSKKkLrtAKZzJf5wagS5jGc7w==',key_name='tempest-keypair-1468650109',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ab3a7e094618456381891d4532bb3cf2',ramdisk_id='',reservation_id='r-34cd3eyb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-246329900',owner_user_name='tempest-TaggedAttachmentsTest-246329900-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016ee10024d2449c93d67e0b14f09f95',uuid=15df44a4-fc31-4dfa-870d-0dd1db47ccd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "address": "fa:16:3e:e8:50:59", "network": {"id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-39095167", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f24d4d-80", "ovs_interfaceid": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Converting VIF {"id": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "address": "fa:16:3e:e8:50:59", "network": {"id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-39095167", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f24d4d-80", "ovs_interfaceid": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:50:59,bridge_name='br-int',has_traffic_filtering=True,id=86f24d4d-809a-47a3-9ca5-b45042e95ce8,network=Network(6601e2e2-96c0-4f49-8364-366da0f3a5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f24d4d-80') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG os_vif [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:50:59,bridge_name='br-int',has_traffic_filtering=True,id=86f24d4d-809a-47a3-9ca5-b45042e95ce8,network=Network(6601e2e2-96c0-4f49-8364-366da0f3a5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f24d4d-80') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86f24d4d-80, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86f24d4d-80, col_values=(('external_ids', {'iface-id': '86f24d4d-809a-47a3-9ca5-b45042e95ce8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:50:59', 'vm-uuid': '15df44a4-fc31-4dfa-870d-0dd1db47ccd7'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:56 user nova-compute[72019]: INFO os_vif [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:50:59,bridge_name='br-int',has_traffic_filtering=True,id=86f24d4d-809a-47a3-9ca5-b45042e95ce8,network=Network(6601e2e2-96c0-4f49-8364-366da0f3a5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f24d4d-80')
Apr 14 13:14:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1305382448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1305382448',id=10,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4duIqCv7vEVSja8IqrS2m8nOyBfEtm9GNp6oVWYmKH8ODAqPLRXepqVchMI9s9qHWy17HwfyhVBB5y+o51mGHAALloM+mnGYFQ/OSrPtSKKkLrtAKZzJf5wagS5jGc7w==',key_name='tempest-keypair-1468650109',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ab3a7e094618456381891d4532bb3cf2',ramdisk_id='',reservation_id='r-34cd3eyb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-246329900',owner_user_name='tempest-TaggedAttachmentsTest-246329900-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016ee10024d2449c93d67e0b14f09f95',uuid=15df44a4-fc31-4dfa-870d-0dd1db47ccd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "address": "fa:16:3e:e8:50:59", "network": {"id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-39095167", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f24d4d-80", "ovs_interfaceid": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Converting VIF {"id": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "address": "fa:16:3e:e8:50:59", "network": {"id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-39095167", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f24d4d-80", "ovs_interfaceid": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:50:59,bridge_name='br-int',has_traffic_filtering=True,id=86f24d4d-809a-47a3-9ca5-b45042e95ce8,network=Network(6601e2e2-96c0-4f49-8364-366da0f3a5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f24d4d-80') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] attach device xml: <interface type="ethernet">
Apr 14 13:14:56 user nova-compute[72019]:   <mac address="fa:16:3e:e8:50:59"/>
Apr 14 13:14:56 user nova-compute[72019]:   <model type="virtio"/>
Apr 14 13:14:56 user nova-compute[72019]:   <mtu size="1442"/>
Apr 14 13:14:56 user nova-compute[72019]:   <target dev="tap86f24d4d-80"/>
Apr 14 13:14:56 user nova-compute[72019]: </interface>
Apr 14 13:14:56 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-09485d93-6983-4c37-bb03-ba8bc2a5ca73 req-ff08a246-8cbe-48f6-a202-e4f33834240e service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received event network-vif-plugged-86f24d4d-809a-47a3-9ca5-b45042e95ce8 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-09485d93-6983-4c37-bb03-ba8bc2a5ca73 req-ff08a246-8cbe-48f6-a202-e4f33834240e service nova] Acquiring lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-09485d93-6983-4c37-bb03-ba8bc2a5ca73 req-ff08a246-8cbe-48f6-a202-e4f33834240e service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-09485d93-6983-4c37-bb03-ba8bc2a5ca73 req-ff08a246-8cbe-48f6-a202-e4f33834240e service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-09485d93-6983-4c37-bb03-ba8bc2a5ca73 req-ff08a246-8cbe-48f6-a202-e4f33834240e service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] No waiting events found dispatching network-vif-plugged-86f24d4d-809a-47a3-9ca5-b45042e95ce8 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:14:56 user nova-compute[72019]: WARNING nova.compute.manager [req-09485d93-6983-4c37-bb03-ba8bc2a5ca73 req-ff08a246-8cbe-48f6-a202-e4f33834240e service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received unexpected event network-vif-plugged-86f24d4d-809a-47a3-9ca5-b45042e95ce8 for instance with vm_state active and task_state None.
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.520s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] <== connect_volume: return (1522ms) {'type': 'block', 'scsi_wwn': '26638633834343635', 'path': '/dev/sdk'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638633834343635', 'path': '/dev/sdk'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] No BDM found with device name hda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] No VIF found with MAC fa:16:3e:e8:46:60, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG nova.objects.instance [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lazy-loading 'flavor' on Instance uuid c74c3463-6701-4150-9096-1775785e8e2a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:14:57 user nova-compute[72019]:   <nova:package version="0.0.0"/>
Apr 14 13:14:57 user nova-compute[72019]:   <nova:name>tempest-device-tagging-server-1305382448</nova:name>
Apr 14 13:14:57 user nova-compute[72019]:   <nova:creationTime>2023-04-14 13:14:57</nova:creationTime>
Apr 14 13:14:57 user nova-compute[72019]:   <nova:flavor name="m1.nano">
Apr 14 13:14:57 user nova-compute[72019]:     <nova:memory>128</nova:memory>
Apr 14 13:14:57 user nova-compute[72019]:     <nova:disk>1</nova:disk>
Apr 14 13:14:57 user nova-compute[72019]:     <nova:swap>0</nova:swap>
Apr 14 13:14:57 user nova-compute[72019]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:14:57 user nova-compute[72019]:     <nova:vcpus>1</nova:vcpus>
Apr 14 13:14:57 user nova-compute[72019]:   </nova:flavor>
Apr 14 13:14:57 user nova-compute[72019]:   <nova:owner>
Apr 14 13:14:57 user nova-compute[72019]:     <nova:user uuid="016ee10024d2449c93d67e0b14f09f95">tempest-TaggedAttachmentsTest-246329900-project-member</nova:user>
Apr 14 13:14:57 user nova-compute[72019]:     <nova:project uuid="ab3a7e094618456381891d4532bb3cf2">tempest-TaggedAttachmentsTest-246329900</nova:project>
Apr 14 13:14:57 user nova-compute[72019]:   </nova:owner>
Apr 14 13:14:57 user nova-compute[72019]:   <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:14:57 user nova-compute[72019]:   <nova:ports>
Apr 14 13:14:57 user nova-compute[72019]:     <nova:port uuid="0946e034-1e6c-42d6-a8e2-1b24fabc000c">
Apr 14 13:14:57 user nova-compute[72019]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 13:14:57 user nova-compute[72019]:     </nova:port>
Apr 14 13:14:57 user nova-compute[72019]:     <nova:port uuid="86f24d4d-809a-47a3-9ca5-b45042e95ce8">
Apr 14 13:14:57 user nova-compute[72019]:       <nova:ip type="fixed" address="10.10.10.210" ipVersion="4"/>
Apr 14 13:14:57 user nova-compute[72019]:     </nova:port>
Apr 14 13:14:57 user nova-compute[72019]:   </nova:ports>
Apr 14 13:14:57 user nova-compute[72019]: </nova:instance>
Apr 14 13:14:57 user nova-compute[72019]:  {{(pid=72019) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:14:57 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:14:57 user nova-compute[72019]:   <source dev="/dev/sdk"/>
Apr 14 13:14:57 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:14:57 user nova-compute[72019]:   <serial>3c84a2c9-e024-4e22-bf1f-3c65264d17a0</serial>
Apr 14 13:14:57 user nova-compute[72019]: </disk>
Apr 14 13:14:57 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "interface-15df44a4-fc31-4dfa-870d-0dd1db47ccd7-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.099s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdvqPtuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:57 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:14:57 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:14:57 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1e89b3-128a-4e65-9daf-d7a324ca19ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:14:57 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c99faf8-52a9-4d30-83be-cbffa6c87b26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012] added
Apr 14 13:14:57 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeae88de-e6f2-4adc-802b-34b7af2483c0]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1acc9b-9b3d-4a98-a2cb-4988ef1a3b18]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdvqPtuG {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdvqPtuG" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e03d8b-de4f-428a-9a81-d0c90c05728a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UdvqPtuG'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG nova.network.neutron [req-639181eb-abf5-4d9d-932b-e98f2fdc6df3 req-6e49bed0-6f07-46bf-9a41-c046f6670d42 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Updated VIF entry in instance network info cache for port 86f24d4d-809a-47a3-9ca5-b45042e95ce8. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG nova.network.neutron [req-639181eb-abf5-4d9d-932b-e98f2fdc6df3 req-6e49bed0-6f07-46bf-9a41-c046f6670d42 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Updating instance_info_cache with network_info: [{"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "address": "fa:16:3e:e8:50:59", "network": {"id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-39095167", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f24d4d-80", "ovs_interfaceid": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9abc65d-2994-47d8-9651-8d2b624ee765]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-639181eb-abf5-4d9d-932b-e98f2fdc6df3 req-6e49bed0-6f07-46bf-9a41-c046f6670d42 service nova] Releasing lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[702b102b-0f26-4822-8c84-9cdd3ace67d0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG nova.objects.instance [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lazy-loading 'flavor' on Instance uuid 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] No VIF found with MAC fa:16:3e:86:67:71, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c09f8a-3b37-412e-91d4-b3e2611b75e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012, portal: 172.16.0.220,3260]
Apr 14 13:14:57 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012, portal: 172.16.0.220,3260] successful.
Apr 14 13:14:57 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b3f8c4-9dbf-4918-a999-061885ed1712]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[16da7c53-b75e-4af7-8674-b0e59604e31f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:57 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:57 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "c74c3463-6701-4150-9096-1775785e8e2a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.319s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18068eb-04e4-440b-9c36-312864ade327]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdvqPtuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:57 user nova-compute[72019]: INFO nova.compute.manager [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Attaching volume de854352-8b0b-4f27-ad88-9714392f776d to /dev/vdb
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.utils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[af52cd47-d050-4947-acf8-8a22b2d95c1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8438d65-7b76-40c2-8870-c4b6f008235d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7381ca5c-ffb4-4982-9568-4d09d17c9bed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d3a701-eab9-4b10-b9e7-92dc8d4d637d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:14:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:14:58 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:14:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80a75f9-48cf-49f8-9e7b-9e29b64ad123]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:14:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:14:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:14:58 user nova-compute[72019]: DEBUG os_brick.utils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:58 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Updating existing volume attachment record: 2d825e2b-7863-4c95-b7a2-1f536bbcf2ae {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:14:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "c74c3463-6701-4150-9096-1775785e8e2a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "c74c3463-6701-4150-9096-1775785e8e2a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:58 user nova-compute[72019]: INFO nova.compute.manager [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Detaching volume 3c84a2c9-e024-4e22-bf1f-3c65264d17a0
Apr 14 13:14:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:14:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23764653862333063', 'path': '/dev/sdl'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764653862333063', 'path': '/dev/sdl'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:14:58 user nova-compute[72019]: DEBUG nova.objects.instance [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lazy-loading 'flavor' on Instance uuid f9b4e51c-b24a-4025-8be1-4294d06c18ff {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:14:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:14:58 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:14:58 user nova-compute[72019]:   <source dev="/dev/sdl"/>
Apr 14 13:14:58 user nova-compute[72019]:   <target dev="sdc" bus="scsi"/>
Apr 14 13:14:58 user nova-compute[72019]:   <serial>6129a78c-9792-4a9b-b24f-bf4740cbc012</serial>
Apr 14 13:14:58 user nova-compute[72019]:   <address type="drive" controller="0" unit="2"/>
Apr 14 13:14:58 user nova-compute[72019]: </disk>
Apr 14 13:14:58 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:14:58 user nova-compute[72019]: INFO nova.virt.block_device [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Attempting to driver detach volume 3c84a2c9-e024-4e22-bf1f-3c65264d17a0 from mountpoint /dev/vdb
Apr 14 13:14:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Attempting to detach device vdb from instance c74c3463-6701-4150-9096-1775785e8e2a from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:14:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:14:58 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:14:58 user nova-compute[72019]:   <source dev="/dev/sdk"/>
Apr 14 13:14:58 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:14:58 user nova-compute[72019]:   <serial>3c84a2c9-e024-4e22-bf1f-3c65264d17a0</serial>
Apr 14 13:14:58 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:14:58 user nova-compute[72019]: </disk>
Apr 14 13:14:58 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:14:58 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Successfully detached device vdb from instance c74c3463-6701-4150-9096-1775785e8e2a from the persistent domain config.
Apr 14 13:14:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c74c3463-6701-4150-9096-1775785e8e2a from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:14:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:14:58 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:14:58 user nova-compute[72019]:   <source dev="/dev/sdk"/>
Apr 14 13:14:58 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:14:58 user nova-compute[72019]:   <serial>3c84a2c9-e024-4e22-bf1f-3c65264d17a0</serial>
Apr 14 13:14:58 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:14:58 user nova-compute[72019]: </disk>
Apr 14 13:14:58 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-9266726b-481a-4365-9a72-c9ac26583e03 req-afa84258-2550-49b1-95e7-96dce842b6c2 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received event network-vif-plugged-86f24d4d-809a-47a3-9ca5-b45042e95ce8 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9266726b-481a-4365-9a72-c9ac26583e03 req-afa84258-2550-49b1-95e7-96dce842b6c2 service nova] Acquiring lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9266726b-481a-4365-9a72-c9ac26583e03 req-afa84258-2550-49b1-95e7-96dce842b6c2 service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9266726b-481a-4365-9a72-c9ac26583e03 req-afa84258-2550-49b1-95e7-96dce842b6c2 service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-9266726b-481a-4365-9a72-c9ac26583e03 req-afa84258-2550-49b1-95e7-96dce842b6c2 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] No waiting events found dispatching network-vif-plugged-86f24d4d-809a-47a3-9ca5-b45042e95ce8 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:14:59 user nova-compute[72019]: WARNING nova.compute.manager [req-9266726b-481a-4365-9a72-c9ac26583e03 req-afa84258-2550-49b1-95e7-96dce842b6c2 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received unexpected event network-vif-plugged-86f24d4d-809a-47a3-9ca5-b45042e95ce8 for instance with vm_state active and task_state None.
Apr 14 13:14:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] No BDM found with device name sda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] No VIF found with MAC fa:16:3e:8c:5b:a5, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.949s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478099.477128, c74c3463-6701-4150-9096-1775785e8e2a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c74c3463-6701-4150-9096-1775785e8e2a {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:14:59 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Successfully detached device vdb from instance c74c3463-6701-4150-9096-1775785e8e2a from the live domain config.
Apr 14 13:14:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSYInAGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:14:59 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcfaafc-7bd4-4e1d-88a2-40c08b1badc1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:14:59 user nova-compute[72019]: No targets found.
Apr 14 13:14:59 user nova-compute[72019]: iSNS:
Apr 14 13:14:59 user nova-compute[72019]: No targets found.
Apr 14 13:14:59 user nova-compute[72019]: STATIC:
Apr 14 13:14:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012
Apr 14 13:14:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:14:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5
Apr 14 13:14:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6
Apr 14 13:14:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21
Apr 14 13:14:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160
Apr 14 13:14:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0
Apr 14 13:14:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc
Apr 14 13:14:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92
Apr 14 13:14:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:14:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1
Apr 14 13:14:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:14:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:14:59 user nova-compute[72019]: FIRMWARE:
Apr 14 13:14:59 user nova-compute[72019]: No targets found.
Apr 14 13:14:59 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:14:59 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:14:59 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adf78d5-3c14-427d-bfe7-94b9527e2d24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10b4b6d-32b8-4db9-8981-3cd132cfe9cd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:14:59 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:14:59 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74907972e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0'): ({'sdk'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Removing single pathed devices sdk {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f9f249-5d99-4528-848d-dc62a5e4716e]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9dfcb1-a744-4529-b8e9-bf60650745f3]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Flushing IO for device /dev/sdk {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[007f4b5e-bda2-42a1-84c8-70c2c1e33e52]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.041s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecd6c2b-59f2-4ce6-a21e-e1569c7afe64]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] SCSI volumes sdk have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b84439d-cc68-4b12-9260-370695c4729a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9751eb5-7d5a-49b0-8c33-67df6c6efa14]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0, portal: 172.16.0.220,3260]
Apr 14 13:14:59 user nova-compute[72019]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0, portal: 172.16.0.220,3260] successful.
Apr 14 13:14:59 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c84a2c9-e024-4e22-bf1f-3c65264d17a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.056s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4627d5f-2a04-4643-95c0-f4445d4e4f77]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] <== disconnect_volume: return (379ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:14:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:15:00 user nova-compute[72019]: DEBUG nova.objects.instance [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lazy-loading 'flavor' on Instance uuid c74c3463-6701-4150-9096-1775785e8e2a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "c74c3463-6701-4150-9096-1775785e8e2a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.009s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:01 user nova-compute[72019]: INFO nova.compute.manager [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Detaching volume 6129a78c-9792-4a9b-b24f-bf4740cbc012
Apr 14 13:15:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:01 user nova-compute[72019]: INFO nova.virt.block_device [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Attempting to driver detach volume 6129a78c-9792-4a9b-b24f-bf4740cbc012 from mountpoint /dev/sdc
Apr 14 13:15:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Attempting to detach device sdc from instance f9b4e51c-b24a-4025-8be1-4294d06c18ff from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:15:01 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:15:01 user nova-compute[72019]:   <source dev="/dev/sdl"/>
Apr 14 13:15:01 user nova-compute[72019]:   <target dev="sdc" bus="scsi"/>
Apr 14 13:15:01 user nova-compute[72019]:   <serial>6129a78c-9792-4a9b-b24f-bf4740cbc012</serial>
Apr 14 13:15:01 user nova-compute[72019]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 13:15:01 user nova-compute[72019]: </disk>
Apr 14 13:15:01 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:15:01 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Successfully detached device sdc from instance f9b4e51c-b24a-4025-8be1-4294d06c18ff from the persistent domain config.
Apr 14 13:15:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f9b4e51c-b24a-4025-8be1-4294d06c18ff from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:15:01 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:15:01 user nova-compute[72019]:   <source dev="/dev/sdl"/>
Apr 14 13:15:01 user nova-compute[72019]:   <target dev="sdc" bus="scsi"/>
Apr 14 13:15:01 user nova-compute[72019]:   <serial>6129a78c-9792-4a9b-b24f-bf4740cbc012</serial>
Apr 14 13:15:01 user nova-compute[72019]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 13:15:01 user nova-compute[72019]: </disk>
Apr 14 13:15:01 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478101.7988431, f9b4e51c-b24a-4025-8be1-4294d06c18ff => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f9b4e51c-b24a-4025-8be1-4294d06c18ff {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:15:01 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Successfully detached device sdc from instance f9b4e51c-b24a-4025-8be1-4294d06c18ff from the live domain config.
Apr 14 13:15:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdvqPtuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:01 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8056fbd8-e7d2-449a-95cc-b044210929d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:15:01 user nova-compute[72019]: No targets found.
Apr 14 13:15:01 user nova-compute[72019]: iSNS:
Apr 14 13:15:01 user nova-compute[72019]: No targets found.
Apr 14 13:15:01 user nova-compute[72019]: STATIC:
Apr 14 13:15:01 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012
Apr 14 13:15:01 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:01 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:01 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:15:01 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:01 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:01 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5
Apr 14 13:15:01 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:01 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:01 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6
Apr 14 13:15:01 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:01 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:01 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21
Apr 14 13:15:01 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:01 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:01 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160
Apr 14 13:15:01 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:01 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:01 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc
Apr 14 13:15:01 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:01 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:01 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92
Apr 14 13:15:01 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:01 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:01 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:15:01 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:01 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:01 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1
Apr 14 13:15:01 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:01 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:01 user nova-compute[72019]: FIRMWARE:
Apr 14 13:15:01 user nova-compute[72019]: No targets found.
Apr 14 13:15:01 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:15:01 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:15:01 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b981e33c-1ea9-42e8-986d-965250d06198]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dd93b6-06c1-46c0-90cd-2dd53ca26736]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:01 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:01 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7490440280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012'): ({'sdl'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Removing single pathed devices sdl {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8e9342-86be-4ccb-bf5d-b60d8969f66a]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8907998b-a138-4b75-a5eb-0b20f9f62092]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Flushing IO for device /dev/sdl {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[305b415b-3ea3-4f31-9b22-2ffec6cc9916]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:15:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.047s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6488616-d1d7-42b0-9aa4-25015807c127]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] SCSI volumes sdl have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2416d670-0a84-48f4-9f58-0a235721a1be]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5f08cd-f035-4869-a91c-1d3c2ab4909c]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012, portal: 172.16.0.220,3260]
Apr 14 13:15:02 user nova-compute[72019]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:02 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6129a78c-9792-4a9b-b24f-bf4740cbc012 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.061s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd2d0be-09eb-42de-8445-f40c0d3030a9]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] <== disconnect_volume: return (436ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:15:02 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478087.3385265, e058f6b1-e83b-49af-9ab3-a29b959f211f => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:15:02 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] VM Stopped (Lifecycle Event)
Apr 14 13:15:02 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a6c4104f-1296-4d20-af3d-b746f54472f6 None None] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG nova.objects.instance [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lazy-loading 'flavor' on Instance uuid f9b4e51c-b24a-4025-8be1-4294d06c18ff {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.896s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:03 user nova-compute[72019]: INFO nova.compute.manager [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Terminating instance
Apr 14 13:15:03 user nova-compute[72019]: DEBUG nova.compute.manager [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG nova.compute.manager [req-919f8cc3-0eb2-4b9f-a2e3-c93a8a2a708b req-1fa0df0d-3669-467d-b2b2-9c0b238f12cf service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Received event network-vif-unplugged-c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-919f8cc3-0eb2-4b9f-a2e3-c93a8a2a708b req-1fa0df0d-3669-467d-b2b2-9c0b238f12cf service nova] Acquiring lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-919f8cc3-0eb2-4b9f-a2e3-c93a8a2a708b req-1fa0df0d-3669-467d-b2b2-9c0b238f12cf service nova] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-919f8cc3-0eb2-4b9f-a2e3-c93a8a2a708b req-1fa0df0d-3669-467d-b2b2-9c0b238f12cf service nova] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG nova.compute.manager [req-919f8cc3-0eb2-4b9f-a2e3-c93a8a2a708b req-1fa0df0d-3669-467d-b2b2-9c0b238f12cf service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] No waiting events found dispatching network-vif-unplugged-c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:03 user nova-compute[72019]: DEBUG nova.compute.manager [req-919f8cc3-0eb2-4b9f-a2e3-c93a8a2a708b req-1fa0df0d-3669-467d-b2b2-9c0b238f12cf service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Received event network-vif-unplugged-c32a1dd7-ca19-4b21-8e75-1581be1c0374 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:04 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Instance destroyed successfully.
Apr 14 13:15:04 user nova-compute[72019]: DEBUG nova.objects.instance [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lazy-loading 'resources' on Instance uuid f9b4e51c-b24a-4025-8be1-4294d06c18ff {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1273980598',display_name='tempest-AttachSCSIVolumeTestJSON-server-1273980598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1273980598',id=7,image_ref='73157366-43fa-48ac-9387-0ba6d7637222',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYxk3GOGAG1sfjFiKz6paSv75v5clPigzUPtC8TeGwkIXNOYkWyvxuoItEv01kSH+0A15Mo9E2wd5OTeLGrgiAO+AQs620zYYvv7HS9vO8qQablNjVt9SJHTDMlXo19fA==',key_name='tempest-keypair-1829584132',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c14f43e2f82342ddbdb5c4ceedc96936',ramdisk_id='',reservation_id='r-ecsk4ok2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='73157366-43fa-48ac-9387-0ba6d7637222',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-167485890',owner_user_name='tempest-AttachSCSIVolumeTestJSON-167485890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3975df3ad6084eee8bca5aedfc61ac95',uuid=f9b4e51c-b24a-4025-8be1-4294d06c18ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "address": "fa:16:3e:8c:5b:a5", "network": {"id": "8ce2e5cd-683e-4a90-9604-35890337ad09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-140415757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14f43e2f82342ddbdb5c4ceedc96936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a1dd7-ca", "ovs_interfaceid": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Converting VIF {"id": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "address": "fa:16:3e:8c:5b:a5", "network": {"id": "8ce2e5cd-683e-4a90-9604-35890337ad09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-140415757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14f43e2f82342ddbdb5c4ceedc96936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a1dd7-ca", "ovs_interfaceid": "c32a1dd7-ca19-4b21-8e75-1581be1c0374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:5b:a5,bridge_name='br-int',has_traffic_filtering=True,id=c32a1dd7-ca19-4b21-8e75-1581be1c0374,network=Network(8ce2e5cd-683e-4a90-9604-35890337ad09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32a1dd7-ca') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG os_vif [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:5b:a5,bridge_name='br-int',has_traffic_filtering=True,id=c32a1dd7-ca19-4b21-8e75-1581be1c0374,network=Network(8ce2e5cd-683e-4a90-9604-35890337ad09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32a1dd7-ca') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc32a1dd7-ca, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:04 user nova-compute[72019]: INFO os_vif [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:5b:a5,bridge_name='br-int',has_traffic_filtering=True,id=c32a1dd7-ca19-4b21-8e75-1581be1c0374,network=Network(8ce2e5cd-683e-4a90-9604-35890337ad09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32a1dd7-ca')
Apr 14 13:15:04 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Deleting instance files /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff_del
Apr 14 13:15:04 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Deletion of /opt/stack/data/nova/instances/f9b4e51c-b24a-4025-8be1-4294d06c18ff_del complete
Apr 14 13:15:04 user nova-compute[72019]: INFO nova.compute.manager [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG nova.compute.manager [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IecTLNEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '990b083b-744a-42cb-88f3-7ae16a5abed4', 'attached_at': '', 'detached_at': '', 'volume_id': '3bfe6502-3c9d-4714-a244-31792062ae86', 'serial': '3bfe6502-3c9d-4714-a244-31792062ae86'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwvDItlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '990b083b-744a-42cb-88f3-7ae16a5abed4', 'attached_at': '', 'detached_at': '', 'volume_id': '3ddfd1c1-8f03-4f07-a754-304e70750e92', 'serial'} {{(pid=72019) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IecTLNEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:04 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:04 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:04 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fdbec1-2801-4042-8823-66342964d54a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:15:04 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0534929a-bb7b-4064-8ac6-613aca802678]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86] added
Apr 14 13:15:04 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde4589f-e768-4919-b96f-7de35c437787]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aabf1de-334d-4256-81f3-9b35c9ac76ca]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IecTLNEC {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IecTLNEC" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1131d33a-53cd-4292-ae8a-5c948e266e3e]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IecTLNEC'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5480dc23-57f5-48f1-aba6-2a71803f9645]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b46c59b-71ef-40fe-b4c8-f190b615e544]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ce5a47-3b47-47a4-862e-9032b3820790]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86, portal: 172.16.0.220,3260]
Apr 14 13:15:05 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:05 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[65854b05-c114-4e58-9aa7-32f44c8dfa9a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b3381c-37c0-465f-95c0-3943d6673f68]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:05 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:05 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] HCTL ('42', '-', '-', 0) found on session 14 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b14e2b-5681-47b8-8efb-74f54ccb469f]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IecTLNEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-23703f66-c55c-4602-ac03-1660a56e14a5 req-4cf6c1b5-cc39-45e9-b81d-ed426c4875d8 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Received event network-vif-deleted-c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:05 user nova-compute[72019]: INFO nova.compute.manager [req-23703f66-c55c-4602-ac03-1660a56e14a5 req-4cf6c1b5-cc39-45e9-b81d-ed426c4875d8 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Neutron deleted interface c32a1dd7-ca19-4b21-8e75-1581be1c0374; detaching it from the instance and deleting it from the info cache
Apr 14 13:15:05 user nova-compute[72019]: DEBUG nova.network.neutron [req-23703f66-c55c-4602-ac03-1660a56e14a5 req-4cf6c1b5-cc39-45e9-b81d-ed426c4875d8 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:05 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Took 0.84 seconds to deallocate network for instance.
Apr 14 13:15:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-23703f66-c55c-4602-ac03-1660a56e14a5 req-4cf6c1b5-cc39-45e9-b81d-ed426c4875d8 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Detach interface failed, port_id=c32a1dd7-ca19-4b21-8e75-1581be1c0374, reason: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:05 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Deleted allocations for instance f9b4e51c-b24a-4025-8be1-4294d06c18ff
Apr 14 13:15:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.331s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-779a8a3b-b3f7-4e63-8e3e-f8319e88c682 req-be5acbd2-9e5f-4c70-9f42-1fc43e9f6150 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Received event network-vif-plugged-c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-779a8a3b-b3f7-4e63-8e3e-f8319e88c682 req-be5acbd2-9e5f-4c70-9f42-1fc43e9f6150 service nova] Acquiring lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-779a8a3b-b3f7-4e63-8e3e-f8319e88c682 req-be5acbd2-9e5f-4c70-9f42-1fc43e9f6150 service nova] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-779a8a3b-b3f7-4e63-8e3e-f8319e88c682 req-be5acbd2-9e5f-4c70-9f42-1fc43e9f6150 service nova] Lock "f9b4e51c-b24a-4025-8be1-4294d06c18ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-779a8a3b-b3f7-4e63-8e3e-f8319e88c682 req-be5acbd2-9e5f-4c70-9f42-1fc43e9f6150 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] No waiting events found dispatching network-vif-plugged-c32a1dd7-ca19-4b21-8e75-1581be1c0374 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:06 user nova-compute[72019]: WARNING nova.compute.manager [req-779a8a3b-b3f7-4e63-8e3e-f8319e88c682 req-be5acbd2-9e5f-4c70-9f42-1fc43e9f6150 service nova] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Received unexpected event network-vif-plugged-c32a1dd7-ca19-4b21-8e75-1581be1c0374 for instance with vm_state deleted and task_state None.
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '26131336665346662', 'path': '/dev/sdk'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131336665346662', 'path': '/dev/sdk'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG nova.objects.instance [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lazy-loading 'flavor' on Instance uuid 990b083b-744a-42cb-88f3-7ae16a5abed4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyBSoWAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:06 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:06 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:06 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad527d62-e180-4674-ac0e-2c7e26faca92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:15:06 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b9843c-c533-46ff-8053-6efceec0992e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d] added
Apr 14 13:15:06 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e5e9d3-262b-4295-91a6-c1294d12e61e]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57f6121-94ec-4c6d-90bf-d1e44b90453d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NyBSoWAx {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NyBSoWAx" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[27114814-b4b0-4dd6-b75f-6422ea907bf4]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NyBSoWAx'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db3ff2d-28fc-4472-bb26-d6a99df88820]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[af577946-8a9d-40ad-8a7c-fcca61240c38]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:06 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:06 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --login" returned: 0 in 0.125s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e67a2e8-1465-4772-a4e9-8aa6ce5a8de8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d, portal: 172.16.0.220,3260]
Apr 14 13:15:07 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:07 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f696ddd-bc6f-44eb-bc7b-5976d2668638]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e798e1-c7a3-4503-bdb4-da2e8f3a7b5a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:07 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:07 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] HCTL ('43', '-', '-', 0) found on session 15 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[676e8e26-040d-42b2-8cca-55490e3c0e82]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Searching for a device in session 15 and hctl ['43', '*', '*', 0] yield: None {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 187695104 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 307232768 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Searching for a device in session 15 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:15:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyBSoWAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:15:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '23061616536386138', 'path': '/dev/sdl'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061616536386138', 'path': '/dev/sdl'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:15:08 user nova-compute[72019]: DEBUG nova.objects.instance [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lazy-loading 'flavor' on Instance uuid 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:15:08 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:15:08 user nova-compute[72019]:   <source dev="/dev/sdl"/>
Apr 14 13:15:08 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:15:08 user nova-compute[72019]:   <serial>de854352-8b0b-4f27-ad88-9714392f776d</serial>
Apr 14 13:15:08 user nova-compute[72019]: </disk>
Apr 14 13:15:08 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:15:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 492830720 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:15:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] No BDM found with device name hda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:15:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] No VIF found with MAC fa:16:3e:e8:46:60, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:15:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 630194176 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.203s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:09 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 713031680 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:09 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 893386752 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 1034944512 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:10 user nova-compute[72019]: INFO nova.compute.manager [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Detaching volume de854352-8b0b-4f27-ad88-9714392f776d
Apr 14 13:15:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-bfabc0e3-c2e7-4466-b824-2d01970c1ca5 req-24554df4-3b30-48e1-b6ec-57d76167765d service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-changed-97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-bfabc0e3-c2e7-4466-b824-2d01970c1ca5 req-24554df4-3b30-48e1-b6ec-57d76167765d service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing instance network info cache due to event network-changed-97d7d320-4ac2-41af-86ca-c30f00808f33. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:15:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-bfabc0e3-c2e7-4466-b824-2d01970c1ca5 req-24554df4-3b30-48e1-b6ec-57d76167765d service nova] Acquiring lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:15:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-bfabc0e3-c2e7-4466-b824-2d01970c1ca5 req-24554df4-3b30-48e1-b6ec-57d76167765d service nova] Acquired lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:15:10 user nova-compute[72019]: DEBUG nova.network.neutron [req-bfabc0e3-c2e7-4466-b824-2d01970c1ca5 req-24554df4-3b30-48e1-b6ec-57d76167765d service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Refreshing network info cache for port 97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:15:10 user nova-compute[72019]: INFO nova.virt.block_device [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Attempting to driver detach volume de854352-8b0b-4f27-ad88-9714392f776d from mountpoint /dev/vdb
Apr 14 13:15:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Attempting to detach device vdb from instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:15:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:15:10 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:15:10 user nova-compute[72019]:   <source dev="/dev/sdl"/>
Apr 14 13:15:10 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:15:10 user nova-compute[72019]:   <serial>de854352-8b0b-4f27-ad88-9714392f776d</serial>
Apr 14 13:15:10 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 13:15:10 user nova-compute[72019]: </disk>
Apr 14 13:15:10 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:15:10 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Successfully detached device vdb from instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 from the persistent domain config.
Apr 14 13:15:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:15:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:15:10 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:15:10 user nova-compute[72019]:   <source dev="/dev/sdl"/>
Apr 14 13:15:10 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:15:10 user nova-compute[72019]:   <serial>de854352-8b0b-4f27-ad88-9714392f776d</serial>
Apr 14 13:15:10 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 13:15:10 user nova-compute[72019]: </disk>
Apr 14 13:15:10 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:15:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478111.1373463, 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:15:11 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Successfully detached device vdb from instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 from the live domain config.
Apr 14 13:15:11 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyBSoWAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:11 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG nova.network.neutron [req-bfabc0e3-c2e7-4466-b824-2d01970c1ca5 req-24554df4-3b30-48e1-b6ec-57d76167765d service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updated VIF entry in instance network info cache for port 97d7d320-4ac2-41af-86ca-c30f00808f33. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG nova.network.neutron [req-bfabc0e3-c2e7-4466-b824-2d01970c1ca5 req-24554df4-3b30-48e1-b6ec-57d76167765d service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating instance_info_cache with network_info: [{"id": "97d7d320-4ac2-41af-86ca-c30f00808f33", "address": "fa:16:3e:83:c6:aa", "network": {"id": "792a09f0-bb03-4d2c-a902-a533c081fdda", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1710316548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97d7d320-4a", "ovs_interfaceid": "97d7d320-4ac2-41af-86ca-c30f00808f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "address": "fa:16:3e:2d:63:6a", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4f98b7-b1", "ovs_interfaceid": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "089a686b-763d-41df-b624-291933367593", "address": "fa:16:3e:28:ca:6e", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap089a686b-76", "ovs_interfaceid": "089a686b-763d-41df-b624-291933367593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96beb287-2181-4df4-b835-a9f071ace5df", "address": "fa:16:3e:a8:73:9b", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96beb287-21", "ovs_interfaceid": "96beb287-2181-4df4-b835-a9f071ace5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "address": "fa:16:3e:01:92:b8", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a4f2864-33", "ovs_interfaceid": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "address": "fa:16:3e:3a:52:8a", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2904a0c-90", "ovs_interfaceid": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "address": "fa:16:3e:3b:18:e7", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d62e14d-6c", "ovs_interfaceid": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe720109-d99b-4eac-84bd-e3879de3c400]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:15:11 user nova-compute[72019]: No targets found.
Apr 14 13:15:11 user nova-compute[72019]: iSNS:
Apr 14 13:15:11 user nova-compute[72019]: No targets found.
Apr 14 13:15:11 user nova-compute[72019]: STATIC:
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: FIRMWARE:
Apr 14 13:15:11 user nova-compute[72019]: No targets found.
Apr 14 13:15:11 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:15:11 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:15:11 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-bfabc0e3-c2e7-4466-b824-2d01970c1ca5 req-24554df4-3b30-48e1-b6ec-57d76167765d service nova] Releasing lock "refresh_cache-7cf6ed7d-a98e-4984-967c-148e1537a118" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwvDItlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:11 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[751b442d-6c0d-412b-9fd0-3b86e41f9380]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[963ca5a0-26c1-472d-8d6c-2161b159de37]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f749cb8b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d'): ({'sdl'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Removing single pathed devices sdl {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e7c76d-b63b-43f5-b58d-744ef3c61590]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[380c266d-1d8f-4402-969f-78757488e1d8]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Flushing IO for device /dev/sdl {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0426891-2cde-431b-8cec-7ad5a7bd982d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.054s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecbc7cc-795d-47af-938a-c7efd758dc93]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] SCSI volumes sdl have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c0a0fe-2717-407f-bfa4-0f329ec09002]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f490e2-0d81-4c1d-8324-bf149e5259d0]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d, portal: 172.16.0.220,3260]
Apr 14 13:15:11 user nova-compute[72019]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:11 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de854352-8b0b-4f27-ad88-9714392f776d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4e8a52-4a56-4cd3-a01c-f5e78cc5d035]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] <== disconnect_volume: return (404ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.352s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cb118c-88f2-41ec-b0be-87fa1fcda014]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:15:11 user nova-compute[72019]: No targets found.
Apr 14 13:15:11 user nova-compute[72019]: iSNS:
Apr 14 13:15:11 user nova-compute[72019]: No targets found.
Apr 14 13:15:11 user nova-compute[72019]: STATIC:
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1
Apr 14 13:15:11 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:11 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:11 user nova-compute[72019]: FIRMWARE:
Apr 14 13:15:11 user nova-compute[72019]: No targets found.
Apr 14 13:15:11 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:15:11 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:15:11 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fb5b85-7bf6-4feb-ba2c-0de8b5c5712e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9d209f-d895-420e-861c-b7b838388e3b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:11 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:11 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7490350280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92'): ({'sdj'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Removing single pathed devices sdj {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0c36b4-9fa2-4eb1-b37b-9aca4a751aff]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e764ddec-dc20-487b-a09d-3ef120a014eb]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Flushing IO for device /dev/sdj {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda29c0d-8e4a-49b8-bdbe-c91206e58a63]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.048s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd254fd9-8cad-4ed4-85d2-d03975ebb40c]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] SCSI volumes sdj have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b07a89-0989-420d-94a8-8e49277372fd]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52247f3-ecb0-45cd-82b3-c7714377c06d]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260]
Apr 14 13:15:11 user nova-compute[72019]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:11 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad9980c-0625-47bb-882a-0260d035c781]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] <== disconnect_volume: return (755ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:11 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-e228625e-0cb9-4f67-b56a-dcb3427610d4 req-49b212f5-f38b-48fb-8641-b458b773719f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-changed-4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-e228625e-0cb9-4f67-b56a-dcb3427610d4 req-49b212f5-f38b-48fb-8641-b458b773719f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing instance network info cache due to event network-changed-4fef6c1f-75be-46b1-b091-f3717d65bb21. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e228625e-0cb9-4f67-b56a-dcb3427610d4 req-49b212f5-f38b-48fb-8641-b458b773719f service nova] Acquiring lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e228625e-0cb9-4f67-b56a-dcb3427610d4 req-49b212f5-f38b-48fb-8641-b458b773719f service nova] Acquired lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG nova.network.neutron [req-e228625e-0cb9-4f67-b56a-dcb3427610d4 req-49b212f5-f38b-48fb-8641-b458b773719f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Refreshing network info cache for port 4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IecTLNEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '990b083b-744a-42cb-88f3-7ae16a5abed4', 'attached_at': '', 'detached_at': '', 'volume_id': '3bfe6502-3c9d-4714-a244-31792062ae86', 'serial'} {{(pid=72019) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] swap_volume: removing Cinder connection for volume 3ddfd1c1-8f03-4f07-a754-304e70750e92 {{(pid=72019) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG nova.objects.instance [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lazy-loading 'flavor' on Instance uuid 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:12 user nova-compute[72019]: INFO nova.compute.manager [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Terminating instance
Apr 14 13:15:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.946s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG nova.network.neutron [req-e228625e-0cb9-4f67-b56a-dcb3427610d4 req-49b212f5-f38b-48fb-8641-b458b773719f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updated VIF entry in instance network info cache for port 4fef6c1f-75be-46b1-b091-f3717d65bb21. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG nova.network.neutron [req-e228625e-0cb9-4f67-b56a-dcb3427610d4 req-49b212f5-f38b-48fb-8641-b458b773719f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating instance_info_cache with network_info: [{"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "address": "fa:16:3e:30:86:89", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3adf3c-41", "ovs_interfaceid": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64455602-0478-47d7-9d50-551d552ceb26", "address": "fa:16:3e:d1:4a:1e", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64455602-04", "ovs_interfaceid": "64455602-0478-47d7-9d50-551d552ceb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "address": "fa:16:3e:50:00:be", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64a492-8e", "ovs_interfaceid": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e228625e-0cb9-4f67-b56a-dcb3427610d4 req-49b212f5-f38b-48fb-8641-b458b773719f service nova] Releasing lock "refresh_cache-7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "interface-15df44a4-fc31-4dfa-870d-0dd1db47ccd7-86f24d4d-809a-47a3-9ca5-b45042e95ce8" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "interface-15df44a4-fc31-4dfa-870d-0dd1db47ccd7-86f24d4d-809a-47a3-9ca5-b45042e95ce8" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG nova.objects.instance [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lazy-loading 'flavor' on Instance uuid 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1305382448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1305382448',id=10,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4duIqCv7vEVSja8IqrS2m8nOyBfEtm9GNp6oVWYmKH8ODAqPLRXepqVchMI9s9qHWy17HwfyhVBB5y+o51mGHAALloM+mnGYFQ/OSrPtSKKkLrtAKZzJf5wagS5jGc7w==',key_name='tempest-keypair-1468650109',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab3a7e094618456381891d4532bb3cf2',ramdisk_id='',reservation_id='r-34cd3eyb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-246329900',owner_user_name='tempest-TaggedAttachmentsTest-246329900-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016ee10024d2449c93d67e0b14f09f95',uuid=15df44a4-fc31-4dfa-870d-0dd1db47ccd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "address": "fa:16:3e:e8:50:59", "network": {"id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-39095167", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f24d4d-80", "ovs_interfaceid": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Converting VIF {"id": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "address": "fa:16:3e:e8:50:59", "network": {"id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-39095167", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f24d4d-80", "ovs_interfaceid": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:50:59,bridge_name='br-int',has_traffic_filtering=True,id=86f24d4d-809a-47a3-9ca5-b45042e95ce8,network=Network(6601e2e2-96c0-4f49-8364-366da0f3a5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f24d4d-80') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e8:50:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap86f24d4d-80"/></interface> {{(pid=72019) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e8:50:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap86f24d4d-80"/></interface> {{(pid=72019) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] swap_volume: Updating volume 3ddfd1c1-8f03-4f07-a754-304e70750e92 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "IecTLNEC", "auth_password": "y1T8cKRDCvt2Mf", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "3bfe6502-3c9d-4714-a244-31792062ae86"}, "status": "reserved", "instance": "990b083b-744a-42cb-88f3-7ae16a5abed4", "attached_at": "", "detached_at": "", "volume_id": "3bfe6502-3c9d-4714-a244-31792062ae86", "serial": "3bfe6502-3c9d-4714-a244-31792062ae86"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3bfe6502-3c9d-4714-a244-31792062ae86', 'no_device': None, 'attachment_id': '4683d724-82b3-447d-9dbc-f22353faa598'} {{(pid=72019) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Attempting to detach device tap86f24d4d-80 from instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] detach device xml: <interface type="ethernet">
Apr 14 13:15:13 user nova-compute[72019]:   <mac address="fa:16:3e:e8:50:59"/>
Apr 14 13:15:13 user nova-compute[72019]:   <model type="virtio"/>
Apr 14 13:15:13 user nova-compute[72019]:   <mtu size="1442"/>
Apr 14 13:15:13 user nova-compute[72019]:   <target dev="tap86f24d4d-80"/>
Apr 14 13:15:13 user nova-compute[72019]: </interface>
Apr 14 13:15:13 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e8:50:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap86f24d4d-80"/></interface> {{(pid=72019) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e8:50:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap86f24d4d-80"/></interface>not found in domain: <domain type='kvm' id='10'>
Apr 14 13:15:13 user nova-compute[72019]:   <name>instance-0000000a</name>
Apr 14 13:15:13 user nova-compute[72019]:   <uuid>15df44a4-fc31-4dfa-870d-0dd1db47ccd7</uuid>
Apr 14 13:15:13 user nova-compute[72019]:   <metadata>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:15:13 user nova-compute[72019]:   <nova:package version="0.0.0"/>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:name>tempest-device-tagging-server-1305382448</nova:name>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:creationTime>2023-04-14 13:14:57</nova:creationTime>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:flavor name="m1.nano">
Apr 14 13:15:13 user nova-compute[72019]:     <nova:memory>128</nova:memory>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:disk>1</nova:disk>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:swap>0</nova:swap>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:vcpus>1</nova:vcpus>
Apr 14 13:15:13 user nova-compute[72019]:   </nova:flavor>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:owner>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:user uuid="016ee10024d2449c93d67e0b14f09f95">tempest-TaggedAttachmentsTest-246329900-project-member</nova:user>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:project uuid="ab3a7e094618456381891d4532bb3cf2">tempest-TaggedAttachmentsTest-246329900</nova:project>
Apr 14 13:15:13 user nova-compute[72019]:   </nova:owner>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:ports>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:port uuid="0946e034-1e6c-42d6-a8e2-1b24fabc000c">
Apr 14 13:15:13 user nova-compute[72019]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 13:15:13 user nova-compute[72019]:     </nova:port>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:port uuid="86f24d4d-809a-47a3-9ca5-b45042e95ce8">
Apr 14 13:15:13 user nova-compute[72019]:       <nova:ip type="fixed" address="10.10.10.210" ipVersion="4"/>
Apr 14 13:15:13 user nova-compute[72019]:     </nova:port>
Apr 14 13:15:13 user nova-compute[72019]:   </nova:ports>
Apr 14 13:15:13 user nova-compute[72019]: </nova:instance>
Apr 14 13:15:13 user nova-compute[72019]:   </metadata>
Apr 14 13:15:13 user nova-compute[72019]:   <memory unit='KiB'>131072</memory>
Apr 14 13:15:13 user nova-compute[72019]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 13:15:13 user nova-compute[72019]:   <vcpu placement='static'>1</vcpu>
Apr 14 13:15:13 user nova-compute[72019]:   <resource>
Apr 14 13:15:13 user nova-compute[72019]:     <partition>/machine</partition>
Apr 14 13:15:13 user nova-compute[72019]:   </resource>
Apr 14 13:15:13 user nova-compute[72019]:   <sysinfo type='smbios'>
Apr 14 13:15:13 user nova-compute[72019]:     <system>
Apr 14 13:15:13 user nova-compute[72019]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 13:15:13 user nova-compute[72019]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 13:15:13 user nova-compute[72019]:       <entry name='version'>0.0.0</entry>
Apr 14 13:15:13 user nova-compute[72019]:       <entry name='serial'>15df44a4-fc31-4dfa-870d-0dd1db47ccd7</entry>
Apr 14 13:15:13 user nova-compute[72019]:       <entry name='uuid'>15df44a4-fc31-4dfa-870d-0dd1db47ccd7</entry>
Apr 14 13:15:13 user nova-compute[72019]:       <entry name='family'>Virtual Machine</entry>
Apr 14 13:15:13 user nova-compute[72019]:     </system>
Apr 14 13:15:13 user nova-compute[72019]:   </sysinfo>
Apr 14 13:15:13 user nova-compute[72019]:   <os>
Apr 14 13:15:13 user nova-compute[72019]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 13:15:13 user nova-compute[72019]:     <boot dev='hd'/>
Apr 14 13:15:13 user nova-compute[72019]:     <smbios mode='sysinfo'/>
Apr 14 13:15:13 user nova-compute[72019]:   </os>
Apr 14 13:15:13 user nova-compute[72019]:   <features>
Apr 14 13:15:13 user nova-compute[72019]:     <acpi/>
Apr 14 13:15:13 user nova-compute[72019]:     <apic/>
Apr 14 13:15:13 user nova-compute[72019]:     <vmcoreinfo state='on'/>
Apr 14 13:15:13 user nova-compute[72019]:   </features>
Apr 14 13:15:13 user nova-compute[72019]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 13:15:13 user nova-compute[72019]:     <model fallback='forbid'>Nehalem</model>
Apr 14 13:15:13 user nova-compute[72019]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 13:15:13 user nova-compute[72019]:     <feature policy='require' name='vme'/>
Apr 14 13:15:13 user nova-compute[72019]:     <feature policy='require' name='x2apic'/>
Apr 14 13:15:13 user nova-compute[72019]:     <feature policy='require' name='hypervisor'/>
Apr 14 13:15:13 user nova-compute[72019]:   </cpu>
Apr 14 13:15:13 user nova-compute[72019]:   <clock offset='utc'>
Apr 14 13:15:13 user nova-compute[72019]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 13:15:13 user nova-compute[72019]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 13:15:13 user nova-compute[72019]:     <timer name='hpet' present='no'/>
Apr 14 13:15:13 user nova-compute[72019]:   </clock>
Apr 14 13:15:13 user nova-compute[72019]:   <on_poweroff>destroy</on_poweroff>
Apr 14 13:15:13 user nova-compute[72019]:   <on_reboot>restart</on_reboot>
Apr 14 13:15:13 user nova-compute[72019]:   <on_crash>destroy</on_crash>
Apr 14 13:15:13 user nova-compute[72019]:   <devices>
Apr 14 13:15:13 user nova-compute[72019]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 13:15:13 user nova-compute[72019]:     <disk type='file' device='disk'>
Apr 14 13:15:13 user nova-compute[72019]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 13:15:13 user nova-compute[72019]:       <source file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk' index='2'/>
Apr 14 13:15:13 user nova-compute[72019]:       <backingStore type='file' index='3'>
Apr 14 13:15:13 user nova-compute[72019]:         <format type='raw'/>
Apr 14 13:15:13 user nova-compute[72019]:         <source file='/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d'/>
Apr 14 13:15:13 user nova-compute[72019]:         <backingStore/>
Apr 14 13:15:13 user nova-compute[72019]:       </backingStore>
Apr 14 13:15:13 user nova-compute[72019]:       <target dev='vda' bus='virtio'/>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='virtio-disk0'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </disk>
Apr 14 13:15:13 user nova-compute[72019]:     <disk type='file' device='cdrom'>
Apr 14 13:15:13 user nova-compute[72019]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 13:15:13 user nova-compute[72019]:       <source file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk.config' index='1'/>
Apr 14 13:15:13 user nova-compute[72019]:       <backingStore/>
Apr 14 13:15:13 user nova-compute[72019]:       <target dev='hda' bus='ide'/>
Apr 14 13:15:13 user nova-compute[72019]:       <readonly/>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='ide0-0-0'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </disk>
Apr 14 13:15:13 user nova-compute[72019]:     <controller type='usb' index='0' model='none'>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='usb'/>
Apr 14 13:15:13 user nova-compute[72019]:     </controller>
Apr 14 13:15:13 user nova-compute[72019]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='pci.0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </controller>
Apr 14 13:15:13 user nova-compute[72019]:     <controller type='ide' index='0'>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='ide'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 13:15:13 user nova-compute[72019]:     </controller>
Apr 14 13:15:13 user nova-compute[72019]:     <interface type='ethernet'>
Apr 14 13:15:13 user nova-compute[72019]:       <mac address='fa:16:3e:e8:46:60'/>
Apr 14 13:15:13 user nova-compute[72019]:       <target dev='tap0946e034-1e'/>
Apr 14 13:15:13 user nova-compute[72019]:       <model type='virtio'/>
Apr 14 13:15:13 user nova-compute[72019]:       <mtu size='1442'/>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='net0'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </interface>
Apr 14 13:15:13 user nova-compute[72019]:     <interface type='ethernet'>
Apr 14 13:15:13 user nova-compute[72019]:       <mac address='fa:16:3e:e8:50:59'/>
Apr 14 13:15:13 user nova-compute[72019]:       <target dev='tap86f24d4d-80'/>
Apr 14 13:15:13 user nova-compute[72019]:       <model type='virtio'/>
Apr 14 13:15:13 user nova-compute[72019]:       <mtu size='1442'/>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='net1'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </interface>
Apr 14 13:15:13 user nova-compute[72019]:     <serial type='pty'>
Apr 14 13:15:13 user nova-compute[72019]:       <source path='/dev/pts/9'/>
Apr 14 13:15:13 user nova-compute[72019]:       <log file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/console.log' append='off'/>
Apr 14 13:15:13 user nova-compute[72019]:       <target type='isa-serial' port='0'>
Apr 14 13:15:13 user nova-compute[72019]:         <model name='isa-serial'/>
Apr 14 13:15:13 user nova-compute[72019]:       </target>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='serial0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </serial>
Apr 14 13:15:13 user nova-compute[72019]:     <console type='pty' tty='/dev/pts/9'>
Apr 14 13:15:13 user nova-compute[72019]:       <source path='/dev/pts/9'/>
Apr 14 13:15:13 user nova-compute[72019]:       <log file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/console.log' append='off'/>
Apr 14 13:15:13 user nova-compute[72019]:       <target type='serial' port='0'/>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='serial0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </console>
Apr 14 13:15:13 user nova-compute[72019]:     <input type='mouse' bus='ps2'>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='input0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </input>
Apr 14 13:15:13 user nova-compute[72019]:     <input type='keyboard' bus='ps2'>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='input1'/>
Apr 14 13:15:13 user nova-compute[72019]:     </input>
Apr 14 13:15:13 user nova-compute[72019]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Apr 14 13:15:13 user nova-compute[72019]:       <listen type='address' address='0.0.0.0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </graphics>
Apr 14 13:15:13 user nova-compute[72019]:     <audio id='1' type='none'/>
Apr 14 13:15:13 user nova-compute[72019]:     <video>
Apr 14 13:15:13 user nova-compute[72019]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='video0'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </video>
Apr 14 13:15:13 user nova-compute[72019]:     <memballoon model='virtio'>
Apr 14 13:15:13 user nova-compute[72019]:       <stats period='10'/>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='balloon0'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </memballoon>
Apr 14 13:15:13 user nova-compute[72019]:     <rng model='virtio'>
Apr 14 13:15:13 user nova-compute[72019]:       <backend model='random'>/dev/urandom</backend>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='rng0'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </rng>
Apr 14 13:15:13 user nova-compute[72019]:   </devices>
Apr 14 13:15:13 user nova-compute[72019]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 13:15:13 user nova-compute[72019]:     <label>libvirt-15df44a4-fc31-4dfa-870d-0dd1db47ccd7</label>
Apr 14 13:15:13 user nova-compute[72019]:     <imagelabel>libvirt-15df44a4-fc31-4dfa-870d-0dd1db47ccd7</imagelabel>
Apr 14 13:15:13 user nova-compute[72019]:   </seclabel>
Apr 14 13:15:13 user nova-compute[72019]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 13:15:13 user nova-compute[72019]:     <label>+64055:+108</label>
Apr 14 13:15:13 user nova-compute[72019]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 13:15:13 user nova-compute[72019]:   </seclabel>
Apr 14 13:15:13 user nova-compute[72019]: </domain>
Apr 14 13:15:13 user nova-compute[72019]:  {{(pid=72019) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 13:15:13 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Successfully detached device tap86f24d4d-80 from instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 from the persistent domain config.
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] (1/8): Attempting to detach device tap86f24d4d-80 with device alias net1 from instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] detach device xml: <interface type="ethernet">
Apr 14 13:15:13 user nova-compute[72019]:   <mac address="fa:16:3e:e8:50:59"/>
Apr 14 13:15:13 user nova-compute[72019]:   <model type="virtio"/>
Apr 14 13:15:13 user nova-compute[72019]:   <mtu size="1442"/>
Apr 14 13:15:13 user nova-compute[72019]:   <target dev="tap86f24d4d-80"/>
Apr 14 13:15:13 user nova-compute[72019]: </interface>
Apr 14 13:15:13 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.520s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.compute.manager [req-dca9559b-3c5d-416e-ae48-b71c09f3cda1 req-73d43bbc-b463-4edf-b253-7853608b5f63 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-unplugged-97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dca9559b-3c5d-416e-ae48-b71c09f3cda1 req-73d43bbc-b463-4edf-b253-7853608b5f63 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dca9559b-3c5d-416e-ae48-b71c09f3cda1 req-73d43bbc-b463-4edf-b253-7853608b5f63 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dca9559b-3c5d-416e-ae48-b71c09f3cda1 req-73d43bbc-b463-4edf-b253-7853608b5f63 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.compute.manager [req-dca9559b-3c5d-416e-ae48-b71c09f3cda1 req-73d43bbc-b463-4edf-b253-7853608b5f63 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-unplugged-97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.compute.manager [req-dca9559b-3c5d-416e-ae48-b71c09f3cda1 req-73d43bbc-b463-4edf-b253-7853608b5f63 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-unplugged-97d7d320-4ac2-41af-86ca-c30f00808f33 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.compute.manager [req-b3611e72-3229-465d-a547-06975ce1a057 req-7440ab4f-d3ca-44c9-8077-24b535a5ce0e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-unplugged-089a686b-763d-41df-b624-291933367593 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b3611e72-3229-465d-a547-06975ce1a057 req-7440ab4f-d3ca-44c9-8077-24b535a5ce0e service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b3611e72-3229-465d-a547-06975ce1a057 req-7440ab4f-d3ca-44c9-8077-24b535a5ce0e service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b3611e72-3229-465d-a547-06975ce1a057 req-7440ab4f-d3ca-44c9-8077-24b535a5ce0e service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.compute.manager [req-b3611e72-3229-465d-a547-06975ce1a057 req-7440ab4f-d3ca-44c9-8077-24b535a5ce0e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-unplugged-089a686b-763d-41df-b624-291933367593 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.compute.manager [req-b3611e72-3229-465d-a547-06975ce1a057 req-7440ab4f-d3ca-44c9-8077-24b535a5ce0e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-unplugged-089a686b-763d-41df-b624-291933367593 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478113.3386438, 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Start waiting for the detach event from libvirt for device tap86f24d4d-80 with device alias net1 for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e8:50:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap86f24d4d-80"/></interface> {{(pid=72019) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e8:50:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap86f24d4d-80"/></interface>not found in domain: <domain type='kvm' id='10'>
Apr 14 13:15:13 user nova-compute[72019]:   <name>instance-0000000a</name>
Apr 14 13:15:13 user nova-compute[72019]:   <uuid>15df44a4-fc31-4dfa-870d-0dd1db47ccd7</uuid>
Apr 14 13:15:13 user nova-compute[72019]:   <metadata>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:15:13 user nova-compute[72019]:   <nova:package version="0.0.0"/>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:name>tempest-device-tagging-server-1305382448</nova:name>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:creationTime>2023-04-14 13:14:57</nova:creationTime>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:flavor name="m1.nano">
Apr 14 13:15:13 user nova-compute[72019]:     <nova:memory>128</nova:memory>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:disk>1</nova:disk>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:swap>0</nova:swap>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:vcpus>1</nova:vcpus>
Apr 14 13:15:13 user nova-compute[72019]:   </nova:flavor>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:owner>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:user uuid="016ee10024d2449c93d67e0b14f09f95">tempest-TaggedAttachmentsTest-246329900-project-member</nova:user>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:project uuid="ab3a7e094618456381891d4532bb3cf2">tempest-TaggedAttachmentsTest-246329900</nova:project>
Apr 14 13:15:13 user nova-compute[72019]:   </nova:owner>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:ports>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:port uuid="0946e034-1e6c-42d6-a8e2-1b24fabc000c">
Apr 14 13:15:13 user nova-compute[72019]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 13:15:13 user nova-compute[72019]:     </nova:port>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:port uuid="86f24d4d-809a-47a3-9ca5-b45042e95ce8">
Apr 14 13:15:13 user nova-compute[72019]:       <nova:ip type="fixed" address="10.10.10.210" ipVersion="4"/>
Apr 14 13:15:13 user nova-compute[72019]:     </nova:port>
Apr 14 13:15:13 user nova-compute[72019]:   </nova:ports>
Apr 14 13:15:13 user nova-compute[72019]: </nova:instance>
Apr 14 13:15:13 user nova-compute[72019]:   </metadata>
Apr 14 13:15:13 user nova-compute[72019]:   <memory unit='KiB'>131072</memory>
Apr 14 13:15:13 user nova-compute[72019]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 13:15:13 user nova-compute[72019]:   <vcpu placement='static'>1</vcpu>
Apr 14 13:15:13 user nova-compute[72019]:   <resource>
Apr 14 13:15:13 user nova-compute[72019]:     <partition>/machine</partition>
Apr 14 13:15:13 user nova-compute[72019]:   </resource>
Apr 14 13:15:13 user nova-compute[72019]:   <sysinfo type='smbios'>
Apr 14 13:15:13 user nova-compute[72019]:     <system>
Apr 14 13:15:13 user nova-compute[72019]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 13:15:13 user nova-compute[72019]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 13:15:13 user nova-compute[72019]:       <entry name='version'>0.0.0</entry>
Apr 14 13:15:13 user nova-compute[72019]:       <entry name='serial'>15df44a4-fc31-4dfa-870d-0dd1db47ccd7</entry>
Apr 14 13:15:13 user nova-compute[72019]:       <entry name='uuid'>15df44a4-fc31-4dfa-870d-0dd1db47ccd7</entry>
Apr 14 13:15:13 user nova-compute[72019]:       <entry name='family'>Virtual Machine</entry>
Apr 14 13:15:13 user nova-compute[72019]:     </system>
Apr 14 13:15:13 user nova-compute[72019]:   </sysinfo>
Apr 14 13:15:13 user nova-compute[72019]:   <os>
Apr 14 13:15:13 user nova-compute[72019]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 13:15:13 user nova-compute[72019]:     <boot dev='hd'/>
Apr 14 13:15:13 user nova-compute[72019]:     <smbios mode='sysinfo'/>
Apr 14 13:15:13 user nova-compute[72019]:   </os>
Apr 14 13:15:13 user nova-compute[72019]:   <features>
Apr 14 13:15:13 user nova-compute[72019]:     <acpi/>
Apr 14 13:15:13 user nova-compute[72019]:     <apic/>
Apr 14 13:15:13 user nova-compute[72019]:     <vmcoreinfo state='on'/>
Apr 14 13:15:13 user nova-compute[72019]:   </features>
Apr 14 13:15:13 user nova-compute[72019]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 13:15:13 user nova-compute[72019]:     <model fallback='forbid'>Nehalem</model>
Apr 14 13:15:13 user nova-compute[72019]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 13:15:13 user nova-compute[72019]:     <feature policy='require' name='vme'/>
Apr 14 13:15:13 user nova-compute[72019]:     <feature policy='require' name='x2apic'/>
Apr 14 13:15:13 user nova-compute[72019]:     <feature policy='require' name='hypervisor'/>
Apr 14 13:15:13 user nova-compute[72019]:   </cpu>
Apr 14 13:15:13 user nova-compute[72019]:   <clock offset='utc'>
Apr 14 13:15:13 user nova-compute[72019]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 13:15:13 user nova-compute[72019]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 13:15:13 user nova-compute[72019]:     <timer name='hpet' present='no'/>
Apr 14 13:15:13 user nova-compute[72019]:   </clock>
Apr 14 13:15:13 user nova-compute[72019]:   <on_poweroff>destroy</on_poweroff>
Apr 14 13:15:13 user nova-compute[72019]:   <on_reboot>restart</on_reboot>
Apr 14 13:15:13 user nova-compute[72019]:   <on_crash>destroy</on_crash>
Apr 14 13:15:13 user nova-compute[72019]:   <devices>
Apr 14 13:15:13 user nova-compute[72019]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 13:15:13 user nova-compute[72019]:     <disk type='file' device='disk'>
Apr 14 13:15:13 user nova-compute[72019]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 13:15:13 user nova-compute[72019]:       <source file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk' index='2'/>
Apr 14 13:15:13 user nova-compute[72019]:       <backingStore type='file' index='3'>
Apr 14 13:15:13 user nova-compute[72019]:         <format type='raw'/>
Apr 14 13:15:13 user nova-compute[72019]:         <source file='/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d'/>
Apr 14 13:15:13 user nova-compute[72019]:         <backingStore/>
Apr 14 13:15:13 user nova-compute[72019]:       </backingStore>
Apr 14 13:15:13 user nova-compute[72019]:       <target dev='vda' bus='virtio'/>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='virtio-disk0'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </disk>
Apr 14 13:15:13 user nova-compute[72019]:     <disk type='file' device='cdrom'>
Apr 14 13:15:13 user nova-compute[72019]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 13:15:13 user nova-compute[72019]:       <source file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk.config' index='1'/>
Apr 14 13:15:13 user nova-compute[72019]:       <backingStore/>
Apr 14 13:15:13 user nova-compute[72019]:       <target dev='hda' bus='ide'/>
Apr 14 13:15:13 user nova-compute[72019]:       <readonly/>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='ide0-0-0'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </disk>
Apr 14 13:15:13 user nova-compute[72019]:     <controller type='usb' index='0' model='none'>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='usb'/>
Apr 14 13:15:13 user nova-compute[72019]:     </controller>
Apr 14 13:15:13 user nova-compute[72019]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='pci.0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </controller>
Apr 14 13:15:13 user nova-compute[72019]:     <controller type='ide' index='0'>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='ide'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 13:15:13 user nova-compute[72019]:     </controller>
Apr 14 13:15:13 user nova-compute[72019]:     <interface type='ethernet'>
Apr 14 13:15:13 user nova-compute[72019]:       <mac address='fa:16:3e:e8:46:60'/>
Apr 14 13:15:13 user nova-compute[72019]:       <target dev='tap0946e034-1e'/>
Apr 14 13:15:13 user nova-compute[72019]:       <model type='virtio'/>
Apr 14 13:15:13 user nova-compute[72019]:       <mtu size='1442'/>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='net0'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </interface>
Apr 14 13:15:13 user nova-compute[72019]:     <serial type='pty'>
Apr 14 13:15:13 user nova-compute[72019]:       <source path='/dev/pts/9'/>
Apr 14 13:15:13 user nova-compute[72019]:       <log file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/console.log' append='off'/>
Apr 14 13:15:13 user nova-compute[72019]:       <target type='isa-serial' port='0'>
Apr 14 13:15:13 user nova-compute[72019]:         <model name='isa-serial'/>
Apr 14 13:15:13 user nova-compute[72019]:       </target>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='serial0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </serial>
Apr 14 13:15:13 user nova-compute[72019]:     <console type='pty' tty='/dev/pts/9'>
Apr 14 13:15:13 user nova-compute[72019]:       <source path='/dev/pts/9'/>
Apr 14 13:15:13 user nova-compute[72019]:       <log file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/console.log' append='off'/>
Apr 14 13:15:13 user nova-compute[72019]:       <target type='serial' port='0'/>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='serial0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </console>
Apr 14 13:15:13 user nova-compute[72019]:     <input type='mouse' bus='ps2'>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='input0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </input>
Apr 14 13:15:13 user nova-compute[72019]:     <input type='keyboard' bus='ps2'>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='input1'/>
Apr 14 13:15:13 user nova-compute[72019]:     </input>
Apr 14 13:15:13 user nova-compute[72019]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Apr 14 13:15:13 user nova-compute[72019]:       <listen type='address' address='0.0.0.0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </graphics>
Apr 14 13:15:13 user nova-compute[72019]:     <audio id='1' type='none'/>
Apr 14 13:15:13 user nova-compute[72019]:     <video>
Apr 14 13:15:13 user nova-compute[72019]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='video0'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </video>
Apr 14 13:15:13 user nova-compute[72019]:     <memballoon model='virtio'>
Apr 14 13:15:13 user nova-compute[72019]:       <stats period='10'/>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='balloon0'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </memballoon>
Apr 14 13:15:13 user nova-compute[72019]:     <rng model='virtio'>
Apr 14 13:15:13 user nova-compute[72019]:       <backend model='random'>/dev/urandom</backend>
Apr 14 13:15:13 user nova-compute[72019]:       <alias name='rng0'/>
Apr 14 13:15:13 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 13:15:13 user nova-compute[72019]:     </rng>
Apr 14 13:15:13 user nova-compute[72019]:   </devices>
Apr 14 13:15:13 user nova-compute[72019]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 13:15:13 user nova-compute[72019]:     <label>libvirt-15df44a4-fc31-4dfa-870d-0dd1db47ccd7</label>
Apr 14 13:15:13 user nova-compute[72019]:     <imagelabel>libvirt-15df44a4-fc31-4dfa-870d-0dd1db47ccd7</imagelabel>
Apr 14 13:15:13 user nova-compute[72019]:   </seclabel>
Apr 14 13:15:13 user nova-compute[72019]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 13:15:13 user nova-compute[72019]:     <label>+64055:+108</label>
Apr 14 13:15:13 user nova-compute[72019]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 13:15:13 user nova-compute[72019]:   </seclabel>
Apr 14 13:15:13 user nova-compute[72019]: </domain>
Apr 14 13:15:13 user nova-compute[72019]:  {{(pid=72019) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 13:15:13 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Successfully detached device tap86f24d4d-80 from instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 from the live domain config.
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1305382448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1305382448',id=10,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4duIqCv7vEVSja8IqrS2m8nOyBfEtm9GNp6oVWYmKH8ODAqPLRXepqVchMI9s9qHWy17HwfyhVBB5y+o51mGHAALloM+mnGYFQ/OSrPtSKKkLrtAKZzJf5wagS5jGc7w==',key_name='tempest-keypair-1468650109',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab3a7e094618456381891d4532bb3cf2',ramdisk_id='',reservation_id='r-34cd3eyb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-246329900',owner_user_name='tempest-TaggedAttachmentsTest-246329900-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016ee10024d2449c93d67e0b14f09f95',uuid=15df44a4-fc31-4dfa-870d-0dd1db47ccd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "address": "fa:16:3e:e8:50:59", "network": {"id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-39095167", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f24d4d-80", "ovs_interfaceid": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Converting VIF {"id": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "address": "fa:16:3e:e8:50:59", "network": {"id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-39095167", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f24d4d-80", "ovs_interfaceid": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:50:59,bridge_name='br-int',has_traffic_filtering=True,id=86f24d4d-809a-47a3-9ca5-b45042e95ce8,network=Network(6601e2e2-96c0-4f49-8364-366da0f3a5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f24d4d-80') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG os_vif [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:50:59,bridge_name='br-int',has_traffic_filtering=True,id=86f24d4d-809a-47a3-9ca5-b45042e95ce8,network=Network(6601e2e2-96c0-4f49-8364-366da0f3a5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f24d4d-80') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86f24d4d-80, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:13 user nova-compute[72019]: INFO os_vif [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:50:59,bridge_name='br-int',has_traffic_filtering=True,id=86f24d4d-809a-47a3-9ca5-b45042e95ce8,network=Network(6601e2e2-96c0-4f49-8364-366da0f3a5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f24d4d-80')
Apr 14 13:15:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:15:13 user nova-compute[72019]:   <nova:package version="0.0.0"/>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:name>tempest-device-tagging-server-1305382448</nova:name>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:creationTime>2023-04-14 13:15:13</nova:creationTime>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:flavor name="m1.nano">
Apr 14 13:15:13 user nova-compute[72019]:     <nova:memory>128</nova:memory>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:disk>1</nova:disk>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:swap>0</nova:swap>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:vcpus>1</nova:vcpus>
Apr 14 13:15:13 user nova-compute[72019]:   </nova:flavor>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:owner>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:user uuid="016ee10024d2449c93d67e0b14f09f95">tempest-TaggedAttachmentsTest-246329900-project-member</nova:user>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:project uuid="ab3a7e094618456381891d4532bb3cf2">tempest-TaggedAttachmentsTest-246329900</nova:project>
Apr 14 13:15:13 user nova-compute[72019]:   </nova:owner>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:15:13 user nova-compute[72019]:   <nova:ports>
Apr 14 13:15:13 user nova-compute[72019]:     <nova:port uuid="0946e034-1e6c-42d6-a8e2-1b24fabc000c">
Apr 14 13:15:13 user nova-compute[72019]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 13:15:13 user nova-compute[72019]:     </nova:port>
Apr 14 13:15:13 user nova-compute[72019]:   </nova:ports>
Apr 14 13:15:13 user nova-compute[72019]: </nova:instance>
Apr 14 13:15:13 user nova-compute[72019]:  {{(pid=72019) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Acquiring lock "990b083b-744a-42cb-88f3-7ae16a5abed4" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG os_brick.utils [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3a5ef5-9228-4a1d-af35-b8f13e5dfd88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[54aa7de3-ac72-44cd-953a-7d04ec910285]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d05339c-c453-4b3e-9842-782eb5908ac7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a903a8-92de-449e-b44c-a49d0cb0be87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:15:13 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:15:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01d731a-6311-4cce-9aa7-d4d6ffffaced]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG os_brick.utils [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: INFO nova.compute.manager [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Swapping volume 3bfe6502-3c9d-4714-a244-31792062ae86 for 3ddfd1c1-8f03-4f07-a754-304e70750e92
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-unplugged-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-unplugged-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-unplugged-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:14 user nova-compute[72019]: WARNING nova.compute.manager [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf for instance with vm_state active and task_state deleting.
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-unplugged-c2904a0c-904d-4dc3-9ffc-aaa05e253319 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-unplugged-c2904a0c-904d-4dc3-9ffc-aaa05e253319 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-unplugged-c2904a0c-904d-4dc3-9ffc-aaa05e253319 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Instance destroyed successfully.
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.objects.instance [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lazy-loading 'resources' on Instance uuid 7cf6ed7d-a98e-4984-967c-148e1537a118 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97d7d320-4ac2-41af-86ca-c30f00808f33", "address": "fa:16:3e:83:c6:aa", "network": {"id": "792a09f0-bb03-4d2c-a902-a533c081fdda", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1710316548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97d7d320-4a", "ovs_interfaceid": "97d7d320-4ac2-41af-86ca-c30f00808f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "97d7d320-4ac2-41af-86ca-c30f00808f33", "address": "fa:16:3e:83:c6:aa", "network": {"id": "792a09f0-bb03-4d2c-a902-a533c081fdda", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1710316548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97d7d320-4a", "ovs_interfaceid": "97d7d320-4ac2-41af-86ca-c30f00808f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:c6:aa,bridge_name='br-int',has_traffic_filtering=True,id=97d7d320-4ac2-41af-86ca-c30f00808f33,network=Network(792a09f0-bb03-4d2c-a902-a533c081fdda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97d7d320-4a') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG os_vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:c6:aa,bridge_name='br-int',has_traffic_filtering=True,id=97d7d320-4ac2-41af-86ca-c30f00808f33,network=Network(792a09f0-bb03-4d2c-a902-a533c081fdda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97d7d320-4a') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97d7d320-4a, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: INFO os_vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:c6:aa,bridge_name='br-int',has_traffic_filtering=True,id=97d7d320-4ac2-41af-86ca-c30f00808f33,network=Network(792a09f0-bb03-4d2c-a902-a533c081fdda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97d7d320-4a')
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "address": "fa:16:3e:2d:63:6a", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4f98b7-b1", "ovs_interfaceid": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "address": "fa:16:3e:2d:63:6a", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4f98b7-b1", "ovs_interfaceid": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:63:6a,bridge_name='br-int',has_traffic_filtering=True,id=ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec4f98b7-b1') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG os_vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:63:6a,bridge_name='br-int',has_traffic_filtering=True,id=ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec4f98b7-b1') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec4f98b7-b1, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:14 user nova-compute[72019]: INFO nova.compute.manager [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Terminating instance
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: INFO os_vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:63:6a,bridge_name='br-int',has_traffic_filtering=True,id=ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec4f98b7-b1')
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "089a686b-763d-41df-b624-291933367593", "address": "fa:16:3e:28:ca:6e", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap089a686b-76", "ovs_interfaceid": "089a686b-763d-41df-b624-291933367593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "089a686b-763d-41df-b624-291933367593", "address": "fa:16:3e:28:ca:6e", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap089a686b-76", "ovs_interfaceid": "089a686b-763d-41df-b624-291933367593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ca:6e,bridge_name='br-int',has_traffic_filtering=True,id=089a686b-763d-41df-b624-291933367593,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap089a686b-76') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG os_vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ca:6e,bridge_name='br-int',has_traffic_filtering=True,id=089a686b-763d-41df-b624-291933367593,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap089a686b-76') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap089a686b-76, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: INFO os_vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ca:6e,bridge_name='br-int',has_traffic_filtering=True,id=089a686b-763d-41df-b624-291933367593,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap089a686b-76')
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96beb287-2181-4df4-b835-a9f071ace5df", "address": "fa:16:3e:a8:73:9b", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96beb287-21", "ovs_interfaceid": "96beb287-2181-4df4-b835-a9f071ace5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "96beb287-2181-4df4-b835-a9f071ace5df", "address": "fa:16:3e:a8:73:9b", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96beb287-21", "ovs_interfaceid": "96beb287-2181-4df4-b835-a9f071ace5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:73:9b,bridge_name='br-int',has_traffic_filtering=True,id=96beb287-2181-4df4-b835-a9f071ace5df,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96beb287-21') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG os_vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:73:9b,bridge_name='br-int',has_traffic_filtering=True,id=96beb287-2181-4df4-b835-a9f071ace5df,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96beb287-21') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96beb287-21, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquired lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.network.neutron [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:15:15 user nova-compute[72019]: INFO os_vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:73:9b,bridge_name='br-int',has_traffic_filtering=True,id=96beb287-2181-4df4-b835-a9f071ace5df,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96beb287-21')
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "address": "fa:16:3e:01:92:b8", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a4f2864-33", "ovs_interfaceid": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "address": "fa:16:3e:01:92:b8", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a4f2864-33", "ovs_interfaceid": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:92:b8,bridge_name='br-int',has_traffic_filtering=True,id=8a4f2864-33fc-4666-bb51-bdd01bc07af4,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a4f2864-33') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:92:b8,bridge_name='br-int',has_traffic_filtering=True,id=8a4f2864-33fc-4666-bb51-bdd01bc07af4,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a4f2864-33') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a4f2864-33, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:15 user nova-compute[72019]: WARNING nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-97d7d320-4ac2-41af-86ca-c30f00808f33 for instance with vm_state active and task_state deleting.
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-unplugged-ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-unplugged-ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-unplugged-ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:15 user nova-compute[72019]: WARNING nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a for instance with vm_state active and task_state deleting.
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-unplugged-8a4f2864-33fc-4666-bb51-bdd01bc07af4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-unplugged-8a4f2864-33fc-4666-bb51-bdd01bc07af4 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-unplugged-8a4f2864-33fc-4666-bb51-bdd01bc07af4 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-8a4f2864-33fc-4666-bb51-bdd01bc07af4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-8a4f2864-33fc-4666-bb51-bdd01bc07af4 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:15 user nova-compute[72019]: WARNING nova.compute.manager [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-8a4f2864-33fc-4666-bb51-bdd01bc07af4 for instance with vm_state active and task_state deleting.
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-089a686b-763d-41df-b624-291933367593 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-089a686b-763d-41df-b624-291933367593 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:15 user nova-compute[72019]: WARNING nova.compute.manager [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-089a686b-763d-41df-b624-291933367593 for instance with vm_state active and task_state deleting.
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-unplugged-96beb287-2181-4df4-b835-a9f071ace5df {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-unplugged-96beb287-2181-4df4-b835-a9f071ace5df {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-unplugged-96beb287-2181-4df4-b835-a9f071ace5df for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-96beb287-2181-4df4-b835-a9f071ace5df {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-96beb287-2181-4df4-b835-a9f071ace5df {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:15 user nova-compute[72019]: WARNING nova.compute.manager [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-96beb287-2181-4df4-b835-a9f071ace5df for instance with vm_state active and task_state deleting.
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received event network-vif-deleted-86f24d4d-809a-47a3-9ca5-b45042e95ce8 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:15 user nova-compute[72019]: INFO nova.compute.manager [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Neutron deleted interface 86f24d4d-809a-47a3-9ca5-b45042e95ce8; detaching it from the instance and deleting it from the info cache
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.network.neutron [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Updating instance_info_cache with network_info: [{"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: INFO os_vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:92:b8,bridge_name='br-int',has_traffic_filtering=True,id=8a4f2864-33fc-4666-bb51-bdd01bc07af4,network=Network(58be4554-9763-4268-a91d-165d6628185f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a4f2864-33')
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "address": "fa:16:3e:3a:52:8a", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2904a0c-90", "ovs_interfaceid": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "address": "fa:16:3e:3a:52:8a", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2904a0c-90", "ovs_interfaceid": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:52:8a,bridge_name='br-int',has_traffic_filtering=True,id=c2904a0c-904d-4dc3-9ffc-aaa05e253319,network=Network(b79d1aea-eb7d-4506-88ad-47003a3aa2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2904a0c-90') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:52:8a,bridge_name='br-int',has_traffic_filtering=True,id=c2904a0c-904d-4dc3-9ffc-aaa05e253319,network=Network(b79d1aea-eb7d-4506-88ad-47003a3aa2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2904a0c-90') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2904a0c-90, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.objects.instance [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Lazy-loading 'system_metadata' on Instance uuid 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.objects.instance [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Lazy-loading 'flavor' on Instance uuid 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1305382448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1305382448',id=10,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4duIqCv7vEVSja8IqrS2m8nOyBfEtm9GNp6oVWYmKH8ODAqPLRXepqVchMI9s9qHWy17HwfyhVBB5y+o51mGHAALloM+mnGYFQ/OSrPtSKKkLrtAKZzJf5wagS5jGc7w==',key_name='tempest-keypair-1468650109',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab3a7e094618456381891d4532bb3cf2',ramdisk_id='',reservation_id='r-34cd3eyb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-246329900',owner_user_name='tempest-TaggedAttachmentsTest-246329900-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016ee10024d2449c93d67e0b14f09f95',uuid=15df44a4-fc31-4dfa-870d-0dd1db47ccd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "address": "fa:16:3e:e8:50:59", "network": {"id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-39095167", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f24d4d-80", "ovs_interfaceid": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.network.os_vif_util [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Converting VIF {"id": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "address": "fa:16:3e:e8:50:59", "network": {"id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-39095167", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f24d4d-80", "ovs_interfaceid": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.network.os_vif_util [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:50:59,bridge_name='br-int',has_traffic_filtering=True,id=86f24d4d-809a-47a3-9ca5-b45042e95ce8,network=Network(6601e2e2-96c0-4f49-8364-366da0f3a5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f24d4d-80') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e8:50:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap86f24d4d-80"/></interface> {{(pid=72019) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e8:50:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap86f24d4d-80"/></interface>not found in domain: <domain type='kvm' id='10'>
Apr 14 13:15:15 user nova-compute[72019]:   <name>instance-0000000a</name>
Apr 14 13:15:15 user nova-compute[72019]:   <uuid>15df44a4-fc31-4dfa-870d-0dd1db47ccd7</uuid>
Apr 14 13:15:15 user nova-compute[72019]:   <metadata>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:15:15 user nova-compute[72019]:   <nova:package version="0.0.0"/>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:name>tempest-device-tagging-server-1305382448</nova:name>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:creationTime>2023-04-14 13:15:13</nova:creationTime>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:flavor name="m1.nano">
Apr 14 13:15:15 user nova-compute[72019]:     <nova:memory>128</nova:memory>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:disk>1</nova:disk>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:swap>0</nova:swap>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:vcpus>1</nova:vcpus>
Apr 14 13:15:15 user nova-compute[72019]:   </nova:flavor>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:owner>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:user uuid="016ee10024d2449c93d67e0b14f09f95">tempest-TaggedAttachmentsTest-246329900-project-member</nova:user>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:project uuid="ab3a7e094618456381891d4532bb3cf2">tempest-TaggedAttachmentsTest-246329900</nova:project>
Apr 14 13:15:15 user nova-compute[72019]:   </nova:owner>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:ports>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:port uuid="0946e034-1e6c-42d6-a8e2-1b24fabc000c">
Apr 14 13:15:15 user nova-compute[72019]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 13:15:15 user nova-compute[72019]:     </nova:port>
Apr 14 13:15:15 user nova-compute[72019]:   </nova:ports>
Apr 14 13:15:15 user nova-compute[72019]: </nova:instance>
Apr 14 13:15:15 user nova-compute[72019]:   </metadata>
Apr 14 13:15:15 user nova-compute[72019]:   <memory unit='KiB'>131072</memory>
Apr 14 13:15:15 user nova-compute[72019]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 13:15:15 user nova-compute[72019]:   <vcpu placement='static'>1</vcpu>
Apr 14 13:15:15 user nova-compute[72019]:   <resource>
Apr 14 13:15:15 user nova-compute[72019]:     <partition>/machine</partition>
Apr 14 13:15:15 user nova-compute[72019]:   </resource>
Apr 14 13:15:15 user nova-compute[72019]:   <sysinfo type='smbios'>
Apr 14 13:15:15 user nova-compute[72019]:     <system>
Apr 14 13:15:15 user nova-compute[72019]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 13:15:15 user nova-compute[72019]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 13:15:15 user nova-compute[72019]:       <entry name='version'>0.0.0</entry>
Apr 14 13:15:15 user nova-compute[72019]:       <entry name='serial'>15df44a4-fc31-4dfa-870d-0dd1db47ccd7</entry>
Apr 14 13:15:15 user nova-compute[72019]:       <entry name='uuid'>15df44a4-fc31-4dfa-870d-0dd1db47ccd7</entry>
Apr 14 13:15:15 user nova-compute[72019]:       <entry name='family'>Virtual Machine</entry>
Apr 14 13:15:15 user nova-compute[72019]:     </system>
Apr 14 13:15:15 user nova-compute[72019]:   </sysinfo>
Apr 14 13:15:15 user nova-compute[72019]:   <os>
Apr 14 13:15:15 user nova-compute[72019]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 13:15:15 user nova-compute[72019]:     <boot dev='hd'/>
Apr 14 13:15:15 user nova-compute[72019]:     <smbios mode='sysinfo'/>
Apr 14 13:15:15 user nova-compute[72019]:   </os>
Apr 14 13:15:15 user nova-compute[72019]:   <features>
Apr 14 13:15:15 user nova-compute[72019]:     <acpi/>
Apr 14 13:15:15 user nova-compute[72019]:     <apic/>
Apr 14 13:15:15 user nova-compute[72019]:     <vmcoreinfo state='on'/>
Apr 14 13:15:15 user nova-compute[72019]:   </features>
Apr 14 13:15:15 user nova-compute[72019]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 13:15:15 user nova-compute[72019]:     <model fallback='forbid'>Nehalem</model>
Apr 14 13:15:15 user nova-compute[72019]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 13:15:15 user nova-compute[72019]:     <feature policy='require' name='vme'/>
Apr 14 13:15:15 user nova-compute[72019]:     <feature policy='require' name='x2apic'/>
Apr 14 13:15:15 user nova-compute[72019]:     <feature policy='require' name='hypervisor'/>
Apr 14 13:15:15 user nova-compute[72019]:   </cpu>
Apr 14 13:15:15 user nova-compute[72019]:   <clock offset='utc'>
Apr 14 13:15:15 user nova-compute[72019]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 13:15:15 user nova-compute[72019]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 13:15:15 user nova-compute[72019]:     <timer name='hpet' present='no'/>
Apr 14 13:15:15 user nova-compute[72019]:   </clock>
Apr 14 13:15:15 user nova-compute[72019]:   <on_poweroff>destroy</on_poweroff>
Apr 14 13:15:15 user nova-compute[72019]:   <on_reboot>restart</on_reboot>
Apr 14 13:15:15 user nova-compute[72019]:   <on_crash>destroy</on_crash>
Apr 14 13:15:15 user nova-compute[72019]:   <devices>
Apr 14 13:15:15 user nova-compute[72019]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 13:15:15 user nova-compute[72019]:     <disk type='file' device='disk'>
Apr 14 13:15:15 user nova-compute[72019]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 13:15:15 user nova-compute[72019]:       <source file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk' index='2'/>
Apr 14 13:15:15 user nova-compute[72019]:       <backingStore type='file' index='3'>
Apr 14 13:15:15 user nova-compute[72019]:         <format type='raw'/>
Apr 14 13:15:15 user nova-compute[72019]:         <source file='/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d'/>
Apr 14 13:15:15 user nova-compute[72019]:         <backingStore/>
Apr 14 13:15:15 user nova-compute[72019]:       </backingStore>
Apr 14 13:15:15 user nova-compute[72019]:       <target dev='vda' bus='virtio'/>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='virtio-disk0'/>
Apr 14 13:15:15 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </disk>
Apr 14 13:15:15 user nova-compute[72019]:     <disk type='file' device='cdrom'>
Apr 14 13:15:15 user nova-compute[72019]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 13:15:15 user nova-compute[72019]:       <source file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk.config' index='1'/>
Apr 14 13:15:15 user nova-compute[72019]:       <backingStore/>
Apr 14 13:15:15 user nova-compute[72019]:       <target dev='hda' bus='ide'/>
Apr 14 13:15:15 user nova-compute[72019]:       <readonly/>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='ide0-0-0'/>
Apr 14 13:15:15 user nova-compute[72019]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </disk>
Apr 14 13:15:15 user nova-compute[72019]:     <controller type='usb' index='0' model='none'>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='usb'/>
Apr 14 13:15:15 user nova-compute[72019]:     </controller>
Apr 14 13:15:15 user nova-compute[72019]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='pci.0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </controller>
Apr 14 13:15:15 user nova-compute[72019]:     <controller type='ide' index='0'>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='ide'/>
Apr 14 13:15:15 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 13:15:15 user nova-compute[72019]:     </controller>
Apr 14 13:15:15 user nova-compute[72019]:     <interface type='ethernet'>
Apr 14 13:15:15 user nova-compute[72019]:       <mac address='fa:16:3e:e8:46:60'/>
Apr 14 13:15:15 user nova-compute[72019]:       <target dev='tap0946e034-1e'/>
Apr 14 13:15:15 user nova-compute[72019]:       <model type='virtio'/>
Apr 14 13:15:15 user nova-compute[72019]:       <mtu size='1442'/>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='net0'/>
Apr 14 13:15:15 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </interface>
Apr 14 13:15:15 user nova-compute[72019]:     <serial type='pty'>
Apr 14 13:15:15 user nova-compute[72019]:       <source path='/dev/pts/9'/>
Apr 14 13:15:15 user nova-compute[72019]:       <log file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/console.log' append='off'/>
Apr 14 13:15:15 user nova-compute[72019]:       <target type='isa-serial' port='0'>
Apr 14 13:15:15 user nova-compute[72019]:         <model name='isa-serial'/>
Apr 14 13:15:15 user nova-compute[72019]:       </target>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='serial0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </serial>
Apr 14 13:15:15 user nova-compute[72019]:     <console type='pty' tty='/dev/pts/9'>
Apr 14 13:15:15 user nova-compute[72019]:       <source path='/dev/pts/9'/>
Apr 14 13:15:15 user nova-compute[72019]:       <log file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/console.log' append='off'/>
Apr 14 13:15:15 user nova-compute[72019]:       <target type='serial' port='0'/>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='serial0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </console>
Apr 14 13:15:15 user nova-compute[72019]:     <input type='mouse' bus='ps2'>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='input0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </input>
Apr 14 13:15:15 user nova-compute[72019]:     <input type='keyboard' bus='ps2'>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='input1'/>
Apr 14 13:15:15 user nova-compute[72019]:     </input>
Apr 14 13:15:15 user nova-compute[72019]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Apr 14 13:15:15 user nova-compute[72019]:       <listen type='address' address='0.0.0.0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </graphics>
Apr 14 13:15:15 user nova-compute[72019]:     <audio id='1' type='none'/>
Apr 14 13:15:15 user nova-compute[72019]:     <video>
Apr 14 13:15:15 user nova-compute[72019]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='video0'/>
Apr 14 13:15:15 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </video>
Apr 14 13:15:15 user nova-compute[72019]:     <memballoon model='virtio'>
Apr 14 13:15:15 user nova-compute[72019]:       <stats period='10'/>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='balloon0'/>
Apr 14 13:15:15 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </memballoon>
Apr 14 13:15:15 user nova-compute[72019]:     <rng model='virtio'>
Apr 14 13:15:15 user nova-compute[72019]:       <backend model='random'>/dev/urandom</backend>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='rng0'/>
Apr 14 13:15:15 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </rng>
Apr 14 13:15:15 user nova-compute[72019]:   </devices>
Apr 14 13:15:15 user nova-compute[72019]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 13:15:15 user nova-compute[72019]:     <label>libvirt-15df44a4-fc31-4dfa-870d-0dd1db47ccd7</label>
Apr 14 13:15:15 user nova-compute[72019]:     <imagelabel>libvirt-15df44a4-fc31-4dfa-870d-0dd1db47ccd7</imagelabel>
Apr 14 13:15:15 user nova-compute[72019]:   </seclabel>
Apr 14 13:15:15 user nova-compute[72019]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 13:15:15 user nova-compute[72019]:     <label>+64055:+108</label>
Apr 14 13:15:15 user nova-compute[72019]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 13:15:15 user nova-compute[72019]:   </seclabel>
Apr 14 13:15:15 user nova-compute[72019]: </domain>
Apr 14 13:15:15 user nova-compute[72019]:  {{(pid=72019) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e8:50:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap86f24d4d-80"/></interface> {{(pid=72019) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e8:50:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap86f24d4d-80"/></interface>not found in domain: <domain type='kvm' id='10'>
Apr 14 13:15:15 user nova-compute[72019]:   <name>instance-0000000a</name>
Apr 14 13:15:15 user nova-compute[72019]:   <uuid>15df44a4-fc31-4dfa-870d-0dd1db47ccd7</uuid>
Apr 14 13:15:15 user nova-compute[72019]:   <metadata>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:15:15 user nova-compute[72019]:   <nova:package version="0.0.0"/>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:name>tempest-device-tagging-server-1305382448</nova:name>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:creationTime>2023-04-14 13:15:13</nova:creationTime>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:flavor name="m1.nano">
Apr 14 13:15:15 user nova-compute[72019]:     <nova:memory>128</nova:memory>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:disk>1</nova:disk>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:swap>0</nova:swap>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:vcpus>1</nova:vcpus>
Apr 14 13:15:15 user nova-compute[72019]:   </nova:flavor>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:owner>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:user uuid="016ee10024d2449c93d67e0b14f09f95">tempest-TaggedAttachmentsTest-246329900-project-member</nova:user>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:project uuid="ab3a7e094618456381891d4532bb3cf2">tempest-TaggedAttachmentsTest-246329900</nova:project>
Apr 14 13:15:15 user nova-compute[72019]:   </nova:owner>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:ports>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:port uuid="0946e034-1e6c-42d6-a8e2-1b24fabc000c">
Apr 14 13:15:15 user nova-compute[72019]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 13:15:15 user nova-compute[72019]:     </nova:port>
Apr 14 13:15:15 user nova-compute[72019]:   </nova:ports>
Apr 14 13:15:15 user nova-compute[72019]: </nova:instance>
Apr 14 13:15:15 user nova-compute[72019]:   </metadata>
Apr 14 13:15:15 user nova-compute[72019]:   <memory unit='KiB'>131072</memory>
Apr 14 13:15:15 user nova-compute[72019]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 13:15:15 user nova-compute[72019]:   <vcpu placement='static'>1</vcpu>
Apr 14 13:15:15 user nova-compute[72019]:   <resource>
Apr 14 13:15:15 user nova-compute[72019]:     <partition>/machine</partition>
Apr 14 13:15:15 user nova-compute[72019]:   </resource>
Apr 14 13:15:15 user nova-compute[72019]:   <sysinfo type='smbios'>
Apr 14 13:15:15 user nova-compute[72019]:     <system>
Apr 14 13:15:15 user nova-compute[72019]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 13:15:15 user nova-compute[72019]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 13:15:15 user nova-compute[72019]:       <entry name='version'>0.0.0</entry>
Apr 14 13:15:15 user nova-compute[72019]:       <entry name='serial'>15df44a4-fc31-4dfa-870d-0dd1db47ccd7</entry>
Apr 14 13:15:15 user nova-compute[72019]:       <entry name='uuid'>15df44a4-fc31-4dfa-870d-0dd1db47ccd7</entry>
Apr 14 13:15:15 user nova-compute[72019]:       <entry name='family'>Virtual Machine</entry>
Apr 14 13:15:15 user nova-compute[72019]:     </system>
Apr 14 13:15:15 user nova-compute[72019]:   </sysinfo>
Apr 14 13:15:15 user nova-compute[72019]:   <os>
Apr 14 13:15:15 user nova-compute[72019]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 13:15:15 user nova-compute[72019]:     <boot dev='hd'/>
Apr 14 13:15:15 user nova-compute[72019]:     <smbios mode='sysinfo'/>
Apr 14 13:15:15 user nova-compute[72019]:   </os>
Apr 14 13:15:15 user nova-compute[72019]:   <features>
Apr 14 13:15:15 user nova-compute[72019]:     <acpi/>
Apr 14 13:15:15 user nova-compute[72019]:     <apic/>
Apr 14 13:15:15 user nova-compute[72019]:     <vmcoreinfo state='on'/>
Apr 14 13:15:15 user nova-compute[72019]:   </features>
Apr 14 13:15:15 user nova-compute[72019]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 13:15:15 user nova-compute[72019]:     <model fallback='forbid'>Nehalem</model>
Apr 14 13:15:15 user nova-compute[72019]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 13:15:15 user nova-compute[72019]:     <feature policy='require' name='vme'/>
Apr 14 13:15:15 user nova-compute[72019]:     <feature policy='require' name='x2apic'/>
Apr 14 13:15:15 user nova-compute[72019]:     <feature policy='require' name='hypervisor'/>
Apr 14 13:15:15 user nova-compute[72019]:   </cpu>
Apr 14 13:15:15 user nova-compute[72019]:   <clock offset='utc'>
Apr 14 13:15:15 user nova-compute[72019]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 13:15:15 user nova-compute[72019]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 13:15:15 user nova-compute[72019]:     <timer name='hpet' present='no'/>
Apr 14 13:15:15 user nova-compute[72019]:   </clock>
Apr 14 13:15:15 user nova-compute[72019]:   <on_poweroff>destroy</on_poweroff>
Apr 14 13:15:15 user nova-compute[72019]:   <on_reboot>restart</on_reboot>
Apr 14 13:15:15 user nova-compute[72019]:   <on_crash>destroy</on_crash>
Apr 14 13:15:15 user nova-compute[72019]:   <devices>
Apr 14 13:15:15 user nova-compute[72019]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 13:15:15 user nova-compute[72019]:     <disk type='file' device='disk'>
Apr 14 13:15:15 user nova-compute[72019]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 13:15:15 user nova-compute[72019]:       <source file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk' index='2'/>
Apr 14 13:15:15 user nova-compute[72019]:       <backingStore type='file' index='3'>
Apr 14 13:15:15 user nova-compute[72019]:         <format type='raw'/>
Apr 14 13:15:15 user nova-compute[72019]:         <source file='/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d'/>
Apr 14 13:15:15 user nova-compute[72019]:         <backingStore/>
Apr 14 13:15:15 user nova-compute[72019]:       </backingStore>
Apr 14 13:15:15 user nova-compute[72019]:       <target dev='vda' bus='virtio'/>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='virtio-disk0'/>
Apr 14 13:15:15 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </disk>
Apr 14 13:15:15 user nova-compute[72019]:     <disk type='file' device='cdrom'>
Apr 14 13:15:15 user nova-compute[72019]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 13:15:15 user nova-compute[72019]:       <source file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk.config' index='1'/>
Apr 14 13:15:15 user nova-compute[72019]:       <backingStore/>
Apr 14 13:15:15 user nova-compute[72019]:       <target dev='hda' bus='ide'/>
Apr 14 13:15:15 user nova-compute[72019]:       <readonly/>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='ide0-0-0'/>
Apr 14 13:15:15 user nova-compute[72019]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </disk>
Apr 14 13:15:15 user nova-compute[72019]:     <controller type='usb' index='0' model='none'>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='usb'/>
Apr 14 13:15:15 user nova-compute[72019]:     </controller>
Apr 14 13:15:15 user nova-compute[72019]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='pci.0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </controller>
Apr 14 13:15:15 user nova-compute[72019]:     <controller type='ide' index='0'>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='ide'/>
Apr 14 13:15:15 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 13:15:15 user nova-compute[72019]:     </controller>
Apr 14 13:15:15 user nova-compute[72019]:     <interface type='ethernet'>
Apr 14 13:15:15 user nova-compute[72019]:       <mac address='fa:16:3e:e8:46:60'/>
Apr 14 13:15:15 user nova-compute[72019]:       <target dev='tap0946e034-1e'/>
Apr 14 13:15:15 user nova-compute[72019]:       <model type='virtio'/>
Apr 14 13:15:15 user nova-compute[72019]:       <mtu size='1442'/>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='net0'/>
Apr 14 13:15:15 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </interface>
Apr 14 13:15:15 user nova-compute[72019]:     <serial type='pty'>
Apr 14 13:15:15 user nova-compute[72019]:       <source path='/dev/pts/9'/>
Apr 14 13:15:15 user nova-compute[72019]:       <log file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/console.log' append='off'/>
Apr 14 13:15:15 user nova-compute[72019]:       <target type='isa-serial' port='0'>
Apr 14 13:15:15 user nova-compute[72019]:         <model name='isa-serial'/>
Apr 14 13:15:15 user nova-compute[72019]:       </target>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='serial0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </serial>
Apr 14 13:15:15 user nova-compute[72019]:     <console type='pty' tty='/dev/pts/9'>
Apr 14 13:15:15 user nova-compute[72019]:       <source path='/dev/pts/9'/>
Apr 14 13:15:15 user nova-compute[72019]:       <log file='/opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/console.log' append='off'/>
Apr 14 13:15:15 user nova-compute[72019]:       <target type='serial' port='0'/>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='serial0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </console>
Apr 14 13:15:15 user nova-compute[72019]:     <input type='mouse' bus='ps2'>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='input0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </input>
Apr 14 13:15:15 user nova-compute[72019]:     <input type='keyboard' bus='ps2'>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='input1'/>
Apr 14 13:15:15 user nova-compute[72019]:     </input>
Apr 14 13:15:15 user nova-compute[72019]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Apr 14 13:15:15 user nova-compute[72019]:       <listen type='address' address='0.0.0.0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </graphics>
Apr 14 13:15:15 user nova-compute[72019]:     <audio id='1' type='none'/>
Apr 14 13:15:15 user nova-compute[72019]:     <video>
Apr 14 13:15:15 user nova-compute[72019]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='video0'/>
Apr 14 13:15:15 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </video>
Apr 14 13:15:15 user nova-compute[72019]:     <memballoon model='virtio'>
Apr 14 13:15:15 user nova-compute[72019]:       <stats period='10'/>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='balloon0'/>
Apr 14 13:15:15 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </memballoon>
Apr 14 13:15:15 user nova-compute[72019]:     <rng model='virtio'>
Apr 14 13:15:15 user nova-compute[72019]:       <backend model='random'>/dev/urandom</backend>
Apr 14 13:15:15 user nova-compute[72019]:       <alias name='rng0'/>
Apr 14 13:15:15 user nova-compute[72019]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 13:15:15 user nova-compute[72019]:     </rng>
Apr 14 13:15:15 user nova-compute[72019]:   </devices>
Apr 14 13:15:15 user nova-compute[72019]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 13:15:15 user nova-compute[72019]:     <label>libvirt-15df44a4-fc31-4dfa-870d-0dd1db47ccd7</label>
Apr 14 13:15:15 user nova-compute[72019]:     <imagelabel>libvirt-15df44a4-fc31-4dfa-870d-0dd1db47ccd7</imagelabel>
Apr 14 13:15:15 user nova-compute[72019]:   </seclabel>
Apr 14 13:15:15 user nova-compute[72019]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 13:15:15 user nova-compute[72019]:     <label>+64055:+108</label>
Apr 14 13:15:15 user nova-compute[72019]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 13:15:15 user nova-compute[72019]:   </seclabel>
Apr 14 13:15:15 user nova-compute[72019]: </domain>
Apr 14 13:15:15 user nova-compute[72019]:  {{(pid=72019) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 13:15:15 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Detaching interface fa:16:3e:e8:50:59 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap86f24d4d-80' not found.
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1305382448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1305382448',id=10,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4duIqCv7vEVSja8IqrS2m8nOyBfEtm9GNp6oVWYmKH8ODAqPLRXepqVchMI9s9qHWy17HwfyhVBB5y+o51mGHAALloM+mnGYFQ/OSrPtSKKkLrtAKZzJf5wagS5jGc7w==',key_name='tempest-keypair-1468650109',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab3a7e094618456381891d4532bb3cf2',ramdisk_id='',reservation_id='r-34cd3eyb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-246329900',owner_user_name='tempest-TaggedAttachmentsTest-246329900-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016ee10024d2449c93d67e0b14f09f95',uuid=15df44a4-fc31-4dfa-870d-0dd1db47ccd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "address": "fa:16:3e:e8:50:59", "network": {"id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-39095167", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f24d4d-80", "ovs_interfaceid": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.network.os_vif_util [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Converting VIF {"id": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "address": "fa:16:3e:e8:50:59", "network": {"id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-39095167", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f24d4d-80", "ovs_interfaceid": "86f24d4d-809a-47a3-9ca5-b45042e95ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.network.os_vif_util [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:50:59,bridge_name='br-int',has_traffic_filtering=True,id=86f24d4d-809a-47a3-9ca5-b45042e95ce8,network=Network(6601e2e2-96c0-4f49-8364-366da0f3a5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f24d4d-80') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_vif [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:50:59,bridge_name='br-int',has_traffic_filtering=True,id=86f24d4d-809a-47a3-9ca5-b45042e95ce8,network=Network(6601e2e2-96c0-4f49-8364-366da0f3a5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f24d4d-80') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86f24d4d-80, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: INFO os_vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:52:8a,bridge_name='br-int',has_traffic_filtering=True,id=c2904a0c-904d-4dc3-9ffc-aaa05e253319,network=Network(b79d1aea-eb7d-4506-88ad-47003a3aa2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2904a0c-90')
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1062604462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1062604462',id=11,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew==',key_name='tempest-keypair-1451174371',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9b68596374d4b918a83f403f2f25143',ramdisk_id='',reservation_id='r-cbb0836c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1775550058',owner_user_name='tempest-TaggedBootDevicesTest-1775550058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7115dcde1a6480e9e2db9cb8d4fdad3',uuid=7cf6ed7d-a98e-4984-967c-148e1537a118,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "address": "fa:16:3e:3b:18:e7", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d62e14d-6c", "ovs_interfaceid": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converting VIF {"id": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "address": "fa:16:3e:3b:18:e7", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d62e14d-6c", "ovs_interfaceid": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:18:e7,bridge_name='br-int',has_traffic_filtering=True,id=1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf,network=Network(b79d1aea-eb7d-4506-88ad-47003a3aa2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d62e14d-6c') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:18:e7,bridge_name='br-int',has_traffic_filtering=True,id=1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf,network=Network(b79d1aea-eb7d-4506-88ad-47003a3aa2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d62e14d-6c') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:15 user nova-compute[72019]: INFO os_vif [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:50:59,bridge_name='br-int',has_traffic_filtering=True,id=86f24d4d-809a-47a3-9ca5-b45042e95ce8,network=Network(6601e2e2-96c0-4f49-8364-366da0f3a5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f24d4d-80')
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:15:15 user nova-compute[72019]:   <nova:package version="0.0.0"/>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:name>tempest-device-tagging-server-1305382448</nova:name>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:creationTime>2023-04-14 13:15:15</nova:creationTime>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:flavor name="m1.nano">
Apr 14 13:15:15 user nova-compute[72019]:     <nova:memory>128</nova:memory>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:disk>1</nova:disk>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:swap>0</nova:swap>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:vcpus>1</nova:vcpus>
Apr 14 13:15:15 user nova-compute[72019]:   </nova:flavor>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:owner>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:user uuid="016ee10024d2449c93d67e0b14f09f95">tempest-TaggedAttachmentsTest-246329900-project-member</nova:user>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:project uuid="ab3a7e094618456381891d4532bb3cf2">tempest-TaggedAttachmentsTest-246329900</nova:project>
Apr 14 13:15:15 user nova-compute[72019]:   </nova:owner>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:15:15 user nova-compute[72019]:   <nova:ports>
Apr 14 13:15:15 user nova-compute[72019]:     <nova:port uuid="0946e034-1e6c-42d6-a8e2-1b24fabc000c">
Apr 14 13:15:15 user nova-compute[72019]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 13:15:15 user nova-compute[72019]:     </nova:port>
Apr 14 13:15:15 user nova-compute[72019]:   </nova:ports>
Apr 14 13:15:15 user nova-compute[72019]: </nova:instance>
Apr 14 13:15:15 user nova-compute[72019]:  {{(pid=72019) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d62e14d-6c, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-unplugged-4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-unplugged-4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-unplugged-4fef6c1f-75be-46b1-b091-f3717d65bb21 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: INFO os_vif [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:18:e7,bridge_name='br-int',has_traffic_filtering=True,id=1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf,network=Network(b79d1aea-eb7d-4506-88ad-47003a3aa2af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d62e14d-6c')
Apr 14 13:15:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOwsuxcS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:15 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb15771c-d5d3-41c0-82ce-c94465061ef4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:15:15 user nova-compute[72019]: No targets found.
Apr 14 13:15:15 user nova-compute[72019]: iSNS:
Apr 14 13:15:15 user nova-compute[72019]: No targets found.
Apr 14 13:15:15 user nova-compute[72019]: STATIC:
Apr 14 13:15:15 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:15:15 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:15 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:15 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5
Apr 14 13:15:15 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:15 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:15 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6
Apr 14 13:15:15 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:15 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:15 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21
Apr 14 13:15:15 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:15 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:15 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160
Apr 14 13:15:15 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:15 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:15 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86
Apr 14 13:15:15 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:15 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:15 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc
Apr 14 13:15:15 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:15 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:15 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:15:15 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:15 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:15 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1
Apr 14 13:15:15 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:15 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:15 user nova-compute[72019]: FIRMWARE:
Apr 14 13:15:15 user nova-compute[72019]: No targets found.
Apr 14 13:15:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:15:15 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:15:15 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3a6c83-4b48-4458-bdb9-d379d613defc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[740544ba-e349-404c-8227-f7ba9d4db2f1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:15 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f749cb89360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21'): ({'sdc'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Removing single pathed devices sdc {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[60140106-1d4a-4902-b1f6-8cb3d8777c7c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d785b4b8-8706-4bd4-abb4-dadcc865e099]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Flushing IO for device /dev/sdc {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e84c81-a22b-4f10-9c0b-4f613c5d6df3]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0955048-9d46-4a00-85c7-2c3a8abb71db]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] SCSI volumes sdc have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f04467-7042-40e4-8585-6ef65ec44497]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: INFO nova.network.neutron [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Port 86f24d4d-809a-47a3-9ca5-b45042e95ce8 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.neutron [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Updating instance_info_cache with network_info: [{"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.132s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e50b7d9-2fc0-425c-bf83-f3bd94436b71]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21, portal: 172.16.0.220,3260]
Apr 14 13:15:16 user nova-compute[72019]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:16 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Releasing lock "refresh_cache-15df44a4-fc31-4dfa-870d-0dd1db47ccd7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "interface-15df44a4-fc31-4dfa-870d-0dd1db47ccd7-86f24d4d-809a-47a3-9ca5-b45042e95ce8" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 3.325s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1c3902-8299-4b2d-814c-3848a40fdb21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78f9b27-a0f7-44ce-95bf-e996d1c57114]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.494s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] <== disconnect_volume: return (497ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqFesKXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:16 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-plugged-c2904a0c-904d-4dc3-9ffc-aaa05e253319 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Acquiring lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] No waiting events found dispatching network-vif-plugged-c2904a0c-904d-4dc3-9ffc-aaa05e253319 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:16 user nova-compute[72019]: WARNING nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received unexpected event network-vif-plugged-c2904a0c-904d-4dc3-9ffc-aaa05e253319 for instance with vm_state active and task_state deleting.
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received event network-vif-unplugged-86f24d4d-809a-47a3-9ca5-b45042e95ce8 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Acquiring lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] No waiting events found dispatching network-vif-unplugged-86f24d4d-809a-47a3-9ca5-b45042e95ce8 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:16 user nova-compute[72019]: WARNING nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received unexpected event network-vif-unplugged-86f24d4d-809a-47a3-9ca5-b45042e95ce8 for instance with vm_state active and task_state None.
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received event network-vif-plugged-86f24d4d-809a-47a3-9ca5-b45042e95ce8 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Acquiring lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] No waiting events found dispatching network-vif-plugged-86f24d4d-809a-47a3-9ca5-b45042e95ce8 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:16 user nova-compute[72019]: WARNING nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received unexpected event network-vif-plugged-86f24d4d-809a-47a3-9ca5-b45042e95ce8 for instance with vm_state active and task_state None.
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-unplugged-3532d3d6-73ac-40eb-9486-d70fac78c992 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-unplugged-3532d3d6-73ac-40eb-9486-d70fac78c992 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-unplugged-3532d3d6-73ac-40eb-9486-d70fac78c992 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-3532d3d6-73ac-40eb-9486-d70fac78c992 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-3532d3d6-73ac-40eb-9486-d70fac78c992 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:16 user nova-compute[72019]: WARNING nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-3532d3d6-73ac-40eb-9486-d70fac78c992 for instance with vm_state active and task_state deleting.
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-unplugged-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-unplugged-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-unplugged-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:16 user nova-compute[72019]: WARNING nova.compute.manager [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 for instance with vm_state active and task_state deleting.
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c698f8a1-43b4-4426-bf70-942f48723b66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:15:16 user nova-compute[72019]: No targets found.
Apr 14 13:15:16 user nova-compute[72019]: iSNS:
Apr 14 13:15:16 user nova-compute[72019]: No targets found.
Apr 14 13:15:16 user nova-compute[72019]: STATIC:
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: FIRMWARE:
Apr 14 13:15:16 user nova-compute[72019]: No targets found.
Apr 14 13:15:16 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:15:16 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:15:16 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7b312e-9bba-4048-bf67-8f644ff42929]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e4c48f-eecf-4b92-9a9f-11bca97fece9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74903ab370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160'): ({'sde'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Removing single pathed devices sde {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[38574578-a438-425c-b6a3-d41269be0870]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb679b5-c5ed-4ed8-a02e-43522dfaf3c2]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Flushing IO for device /dev/sde {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1429dd41-3570-4af1-8c58-1a4b476a2011]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Instance destroyed successfully.
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.objects.instance [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lazy-loading 'resources' on Instance uuid 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:75:b1,bridge_name='br-int',has_traffic_filtering=True,id=4fef6c1f-75be-46b1-b091-f3717d65bb21,network=Network(7e198958-bf78-4f31-a37f-fcf4eb24caa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fef6c1f-75') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:75:b1,bridge_name='br-int',has_traffic_filtering=True,id=4fef6c1f-75be-46b1-b091-f3717d65bb21,network=Network(7e198958-bf78-4f31-a37f-fcf4eb24caa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fef6c1f-75') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6700e0a3-8059-44e0-97f8-bfcd19b73e4c]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fef6c1f-75, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7c240e57', '/dev/disk/by-id/scsi-26137653832303338', '/dev/disk/by-id/scsi-1SCST_BIO7c240e57-a7e82038d1f15091') {{(pid=82397) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47e26b2-df5f-4df8-ab49-3f980253f13d]: (4, None) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[477a2b7a-41b5-4fd9-8922-cbf58be80232]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: INFO os_vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:75:b1,bridge_name='br-int',has_traffic_filtering=True,id=4fef6c1f-75be-46b1-b091-f3717d65bb21,network=Network(7e198958-bf78-4f31-a37f-fcf4eb24caa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fef6c1f-75')
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:95:fe,bridge_name='br-int',has_traffic_filtering=True,id=3532d3d6-73ac-40eb-9486-d70fac78c992,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3532d3d6-73') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:95:fe,bridge_name='br-int',has_traffic_filtering=True,id=3532d3d6-73ac-40eb-9486-d70fac78c992,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3532d3d6-73') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3532d3d6-73, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2219e327-ff0d-41e0-9423-6d77cba10e17]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160, portal: 172.16.0.220,3260]
Apr 14 13:15:16 user nova-compute[72019]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:16 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: INFO os_vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:95:fe,bridge_name='br-int',has_traffic_filtering=True,id=3532d3d6-73ac-40eb-9486-d70fac78c992,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3532d3d6-73')
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:92:cb,bridge_name='br-int',has_traffic_filtering=True,id=3929e20e-3bcb-4e87-bbb3-59f52e6e7047,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3929e20e-3b') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:92:cb,bridge_name='br-int',has_traffic_filtering=True,id=3929e20e-3bcb-4e87-bbb3-59f52e6e7047,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3929e20e-3b') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3929e20e-3b, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09520b36-0291-4949-b4bd-5ef9452f1160 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9673e2e0-7e7e-4179-8a28-ed517b863c68]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] <== disconnect_volume: return (437ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBLOquFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:16 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc13da4-3f78-4622-877e-9fbbe6f00fa6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:15:16 user nova-compute[72019]: No targets found.
Apr 14 13:15:16 user nova-compute[72019]: iSNS:
Apr 14 13:15:16 user nova-compute[72019]: No targets found.
Apr 14 13:15:16 user nova-compute[72019]: STATIC:
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1
Apr 14 13:15:16 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:16 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:16 user nova-compute[72019]: FIRMWARE:
Apr 14 13:15:16 user nova-compute[72019]: No targets found.
Apr 14 13:15:16 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:15:16 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:15:16 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: INFO os_vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:92:cb,bridge_name='br-int',has_traffic_filtering=True,id=3929e20e-3bcb-4e87-bbb3-59f52e6e7047,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3929e20e-3b')
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "address": "fa:16:3e:30:86:89", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3adf3c-41", "ovs_interfaceid": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "address": "fa:16:3e:30:86:89", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3adf3c-41", "ovs_interfaceid": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:86:89,bridge_name='br-int',has_traffic_filtering=True,id=3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3adf3c-41') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:86:89,bridge_name='br-int',has_traffic_filtering=True,id=3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3adf3c-41') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c3adf3c-41, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[63418d40-f909-480e-aa01-97d8e6d457ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d32bfed-606d-48f5-b1fb-2a0d6bf2753d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc (non-flash)
Apr 14 13:15:16 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:16 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74905ca050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc'): ({'sdg'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Removing single pathed devices sdg {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:15:16 user nova-compute[72019]: INFO os_vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:86:89,bridge_name='br-int',has_traffic_filtering=True,id=3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3adf3c-41')
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64455602-0478-47d7-9d50-551d552ceb26", "address": "fa:16:3e:d1:4a:1e", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64455602-04", "ovs_interfaceid": "64455602-0478-47d7-9d50-551d552ceb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "64455602-0478-47d7-9d50-551d552ceb26", "address": "fa:16:3e:d1:4a:1e", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64455602-04", "ovs_interfaceid": "64455602-0478-47d7-9d50-551d552ceb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:4a:1e,bridge_name='br-int',has_traffic_filtering=True,id=64455602-0478-47d7-9d50-551d552ceb26,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64455602-04') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:4a:1e,bridge_name='br-int',has_traffic_filtering=True,id=64455602-0478-47d7-9d50-551d552ceb26,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64455602-04') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64455602-04, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc43ef8b-ab55-4cba-a8aa-2fb07bb0c7f0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeb8ed4-f9b7-4a44-8e41-1bb1043289da]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Flushing IO for device /dev/sdg {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:15:16 user nova-compute[72019]: INFO os_vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:4a:1e,bridge_name='br-int',has_traffic_filtering=True,id=64455602-0478-47d7-9d50-551d552ceb26,network=Network(7396885f-54d3-4b44-93c3-6628072d667b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64455602-04')
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "address": "fa:16:3e:50:00:be", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64a492-8e", "ovs_interfaceid": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "address": "fa:16:3e:50:00:be", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64a492-8e", "ovs_interfaceid": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:00:be,bridge_name='br-int',has_traffic_filtering=True,id=ff64a492-8e97-4c11-9207-bf56011d8a5d,network=Network(51c39db2-b137-4dff-8993-3a97bb48e38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64a492-8e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:00:be,bridge_name='br-int',has_traffic_filtering=True,id=ff64a492-8e97-4c11-9207-bf56011d8a5d,network=Network(51c39db2-b137-4dff-8993-3a97bb48e38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64a492-8e') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff64a492-8e, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03c6058-b521-4db3-9133-dc5062dee786]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: INFO os_vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:00:be,bridge_name='br-int',has_traffic_filtering=True,id=ff64a492-8e97-4c11-9207-bf56011d8a5d,network=Network(51c39db2-b137-4dff-8993-3a97bb48e38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64a492-8e')
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1364405608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1364405608',id=12,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw==',key_name='tempest-keypair-293654497',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16235c48e6fb4457bbd7edfa321929a8',ramdisk_id='',reservation_id='r-7t85q880',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237683370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237683370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b7b010b7f40b0946ec1575216e80d',uuid=7c9e3e27-e027-4e14-84a2-23ae2e5b1b93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converting VIF {"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:db:85,bridge_name='br-int',has_traffic_filtering=True,id=8e63fe4d-bc87-40cb-855e-ad82726ca39d,network=Network(51c39db2-b137-4dff-8993-3a97bb48e38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e63fe4d-bc') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:db:85,bridge_name='br-int',has_traffic_filtering=True,id=8e63fe4d-bc87-40cb-855e-ad82726ca39d,network=Network(51c39db2-b137-4dff-8993-3a97bb48e38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e63fe4d-bc') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e63fe4d-bc, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8488efd7-8068-44eb-ab1e-717d0134de21]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] SCSI volumes sdg have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: INFO os_vif [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:db:85,bridge_name='br-int',has_traffic_filtering=True,id=8e63fe4d-bc87-40cb-855e-ad82726ca39d,network=Network(51c39db2-b137-4dff-8993-3a97bb48e38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e63fe4d-bc')
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHqwWrvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:16 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[842e3115-418a-42d9-bc3d-506d2d54f95d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef79adf-a0be-482c-9e8e-e269c51b50b0]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc, portal: 172.16.0.220,3260]
Apr 14 13:15:16 user nova-compute[72019]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:16 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db7698-a216-42b4-a592-80a4cb5568bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a6e5a6-f0d3-49bc-9f8d-27d1577a1dd6]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] <== disconnect_volume: return (342ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:15:16 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Deleting instance files /opt/stack/data/nova/instances/7cf6ed7d-a98e-4984-967c-148e1537a118_del
Apr 14 13:15:16 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Deletion of /opt/stack/data/nova/instances/7cf6ed7d-a98e-4984-967c-148e1537a118_del complete
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.127s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aff9c72-5e3f-4afb-a1f4-2e6d8fc2173b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:15:17 user nova-compute[72019]: No targets found.
Apr 14 13:15:17 user nova-compute[72019]: iSNS:
Apr 14 13:15:17 user nova-compute[72019]: No targets found.
Apr 14 13:15:17 user nova-compute[72019]: STATIC:
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: FIRMWARE:
Apr 14 13:15:17 user nova-compute[72019]: No targets found.
Apr 14 13:15:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:15:17 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:15:17 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[310e5aa8-0863-48e3-a5ac-6d414b8eb9db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: INFO nova.compute.manager [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Took 4.59 seconds to destroy the instance on the hypervisor.
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e39266-0088-42e8-ae41-49af45dfbb05]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74905c96c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5'): ({'sdb'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Removing single pathed devices sdb {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2955935c-fd57-4670-bc4c-7a6aa15ede73]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6d2cf2-0064-4f3f-95c6-3970fb7cb9ec]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Flushing IO for device /dev/sdb {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[149f70a5-a20b-41f2-accd-d63205f66ea8]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39043cb-25b8-44e8-8490-7b90c1fcce5c]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f09c014-27ef-4b39-89a3-801b5aad8ad0]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-unplugged-8e63fe4d-bc87-40cb-855e-ad82726ca39d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-unplugged-8e63fe4d-bc87-40cb-855e-ad82726ca39d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-unplugged-8e63fe4d-bc87-40cb-855e-ad82726ca39d for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-8e63fe4d-bc87-40cb-855e-ad82726ca39d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-8e63fe4d-bc87-40cb-855e-ad82726ca39d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:17 user nova-compute[72019]: WARNING nova.compute.manager [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-8e63fe4d-bc87-40cb-855e-ad82726ca39d for instance with vm_state active and task_state deleting.
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c83f1f3-7879-4004-9d95-c8d66d683a5e]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5, portal: 172.16.0.220,3260]
Apr 14 13:15:17 user nova-compute[72019]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:17 user nova-compute[72019]: WARNING nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-4fef6c1f-75be-46b1-b091-f3717d65bb21 for instance with vm_state active and task_state deleting.
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-unplugged-3929e20e-3bcb-4e87-bbb3-59f52e6e7047 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-unplugged-3929e20e-3bcb-4e87-bbb3-59f52e6e7047 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-unplugged-3929e20e-3bcb-4e87-bbb3-59f52e6e7047 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-3929e20e-3bcb-4e87-bbb3-59f52e6e7047 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-3929e20e-3bcb-4e87-bbb3-59f52e6e7047 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:17 user nova-compute[72019]: WARNING nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-3929e20e-3bcb-4e87-bbb3-59f52e6e7047 for instance with vm_state active and task_state deleting.
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-unplugged-64455602-0478-47d7-9d50-551d552ceb26 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-unplugged-64455602-0478-47d7-9d50-551d552ceb26 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-unplugged-64455602-0478-47d7-9d50-551d552ceb26 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-64455602-0478-47d7-9d50-551d552ceb26 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-64455602-0478-47d7-9d50-551d552ceb26 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:17 user nova-compute[72019]: WARNING nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-64455602-0478-47d7-9d50-551d552ceb26 for instance with vm_state active and task_state deleting.
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-unplugged-ff64a492-8e97-4c11-9207-bf56011d8a5d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-unplugged-ff64a492-8e97-4c11-9207-bf56011d8a5d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-unplugged-ff64a492-8e97-4c11-9207-bf56011d8a5d for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-plugged-ff64a492-8e97-4c11-9207-bf56011d8a5d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Acquiring lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] No waiting events found dispatching network-vif-plugged-ff64a492-8e97-4c11-9207-bf56011d8a5d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:17 user nova-compute[72019]: WARNING nova.compute.manager [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received unexpected event network-vif-plugged-ff64a492-8e97-4c11-9207-bf56011d8a5d for instance with vm_state active and task_state deleting.
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa72720-6a25-493b-b75c-5e73c01c3047]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] <== disconnect_volume: return (470ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eumCEiMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:17 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9733ff8d-114b-4bf5-8241-ae3d4ea6d1be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:15:17 user nova-compute[72019]: No targets found.
Apr 14 13:15:17 user nova-compute[72019]: iSNS:
Apr 14 13:15:17 user nova-compute[72019]: No targets found.
Apr 14 13:15:17 user nova-compute[72019]: STATIC:
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: FIRMWARE:
Apr 14 13:15:17 user nova-compute[72019]: No targets found.
Apr 14 13:15:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:15:17 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:15:17 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a41731-17eb-4f1b-9bb7-3599a1627e5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24ebcf4-c4c6-4493-8792-31274833d0c4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7490778550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6'): ({'sdd'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Removing single pathed devices sdd {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18c46a4-a15e-40ee-a621-c42ffd6b1777]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88aa58e-ecae-4bad-9943-549a45f12441]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Flushing IO for device /dev/sdd {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7b474c-20d1-4ee6-aff0-674bbfe08ce2]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccd276c-668c-4f1c-84a9-243eb77c864e]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] SCSI volumes sdd have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[719942cf-82c9-431e-9caf-416c30f93e00]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[77370341-bf9a-4682-a0ff-1530d0fd3114]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6, portal: 172.16.0.220,3260]
Apr 14 13:15:17 user nova-compute[72019]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfbc1718-f375-48f6-b94c-63ac9c4807a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca6a7ec-75ce-4182-bab6-f67be0cdfee5]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] <== disconnect_volume: return (288ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVsINeDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:17 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[65946a08-c583-41ff-b3e0-26040a43b5f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:15:17 user nova-compute[72019]: No targets found.
Apr 14 13:15:17 user nova-compute[72019]: iSNS:
Apr 14 13:15:17 user nova-compute[72019]: No targets found.
Apr 14 13:15:17 user nova-compute[72019]: STATIC:
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1
Apr 14 13:15:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:17 user nova-compute[72019]: FIRMWARE:
Apr 14 13:15:17 user nova-compute[72019]: No targets found.
Apr 14 13:15:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:15:17 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:15:17 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee74972d-199a-4f94-91f5-3f97cd425137]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e584cf-b54c-4c1a-9e1e-464276955bd6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7490778550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1'): ({'sdf'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Removing single pathed devices sdf {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[16409186-07ce-447d-a2a2-8342a6288edc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb5cf7a-cb57-4bb1-997e-e29e8fc7c1c1]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Flushing IO for device /dev/sdf {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa90a7d-d3af-4662-9504-9d73e8ae762a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f61880-6c8f-4522-83b9-4cfc4122c428]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] SCSI volumes sdf have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b4a90c-f82f-4b61-998e-1221d53330a4]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab4bdc3-b3d0-45c0-8949-0b79336723a1]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1, portal: 172.16.0.220,3260]
Apr 14 13:15:17 user nova-compute[72019]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24475c44-054d-436f-b2f8-17918c27ccc1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1485f70-bbdc-4787-bd74-24442316a34e]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] <== disconnect_volume: return (322ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:15:17 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Deleting instance files /opt/stack/data/nova/instances/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93_del
Apr 14 13:15:17 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Deletion of /opt/stack/data/nova/instances/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93_del complete
Apr 14 13:15:18 user nova-compute[72019]: INFO nova.compute.manager [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Took 3.42 seconds to destroy the instance on the hypervisor.
Apr 14 13:15:18 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:15:18 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:15:18 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478104.3558407, f9b4e51c-b24a-4025-8be1-4294d06c18ff => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:15:19 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] VM Stopped (Lifecycle Event)
Apr 14 13:15:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-66a9def3-b5ff-4cc4-bc9c-78c7be883e8f None None] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwvDItlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '990b083b-744a-42cb-88f3-7ae16a5abed4', 'attached_at': '', 'detached_at': '', 'volume_id': '3ddfd1c1-8f03-4f07-a754-304e70750e92', 'serial': '3ddfd1c1-8f03-4f07-a754-304e70750e92'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IecTLNEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '3bfe6502-3c9d-4714-a244-31792062ae86'}, 'status': 'reserved', 'instance': '990b083b-744a-42cb-88f3-7ae16a5abed4', 'attached_at': '', 'detached_at': '', 'volume_id': '3bfe6502-3c9d-4714-a244-31792062ae86', 'serial'} {{(pid=72019) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwvDItlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:19 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:19 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:19 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[895fd094-c6bb-4a61-afc2-cff71d7c525b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:15:19 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd10ae0-39fd-4f80-ae45-afd662aa75d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92] added
Apr 14 13:15:19 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[46903d0d-c3e6-442a-9d3b-cb92c10b8e1f]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9847a3-aee1-4819-834d-4cfeacf74d9a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GwvDItlx {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GwvDItlx" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4827a54b-0c5e-4141-addc-6e1d8b374c15]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GwvDItlx'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff4cb4f-7e92-4585-8c7c-86dabcc43c7a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2051657-bd6b-4b8b-8767-ee1b1e37dba3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:19 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:19 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:19 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:19 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:19 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:19 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[80406fd5-26a8-4745-9dc6-8fe29a7bbd42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260]
Apr 14 13:15:19 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:19 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe59bd3d-89b6-49ab-a647-47470735fbaa]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be11051-fbc5-4d7e-98ba-d0e2204b3f36]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:19 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:19 user nova-compute[72019]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:19 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:19 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:19 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:19 user nova-compute[72019]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:19 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:19 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dea51fd-14a4-4951-841a-52a22a7fb2f8]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwvDItlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-5dbccb70-b4cc-44c8-a482-68acad110377 req-c622e1b2-6dae-4395-9d86-7c570089133d service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-deleted-1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:19 user nova-compute[72019]: INFO nova.compute.manager [req-5dbccb70-b4cc-44c8-a482-68acad110377 req-c622e1b2-6dae-4395-9d86-7c570089133d service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Neutron deleted interface 1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf; detaching it from the instance and deleting it from the info cache
Apr 14 13:15:19 user nova-compute[72019]: DEBUG nova.network.neutron [req-5dbccb70-b4cc-44c8-a482-68acad110377 req-c622e1b2-6dae-4395-9d86-7c570089133d service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating instance_info_cache with network_info: [{"id": "97d7d320-4ac2-41af-86ca-c30f00808f33", "address": "fa:16:3e:83:c6:aa", "network": {"id": "792a09f0-bb03-4d2c-a902-a533c081fdda", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1710316548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97d7d320-4a", "ovs_interfaceid": "97d7d320-4ac2-41af-86ca-c30f00808f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "address": "fa:16:3e:2d:63:6a", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4f98b7-b1", "ovs_interfaceid": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "089a686b-763d-41df-b624-291933367593", "address": "fa:16:3e:28:ca:6e", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap089a686b-76", "ovs_interfaceid": "089a686b-763d-41df-b624-291933367593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96beb287-2181-4df4-b835-a9f071ace5df", "address": "fa:16:3e:a8:73:9b", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96beb287-21", "ovs_interfaceid": "96beb287-2181-4df4-b835-a9f071ace5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "address": "fa:16:3e:01:92:b8", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a4f2864-33", "ovs_interfaceid": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "address": "fa:16:3e:3a:52:8a", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2904a0c-90", "ovs_interfaceid": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-5dbccb70-b4cc-44c8-a482-68acad110377 req-c622e1b2-6dae-4395-9d86-7c570089133d service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Detach interface failed, port_id=1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf, reason: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:15:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23563623261313939', 'path': '/dev/sdb'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563623261313939', 'path': '/dev/sdb'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:15:20 user nova-compute[72019]: DEBUG nova.objects.instance [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lazy-loading 'flavor' on Instance uuid 990b083b-744a-42cb-88f3-7ae16a5abed4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 178257920 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-deleted-97d7d320-4ac2-41af-86ca-c30f00808f33 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:21 user nova-compute[72019]: INFO nova.compute.manager [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Neutron deleted interface 97d7d320-4ac2-41af-86ca-c30f00808f33; detaching it from the instance and deleting it from the info cache
Apr 14 13:15:21 user nova-compute[72019]: DEBUG nova.network.neutron [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating instance_info_cache with network_info: [{"id": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "address": "fa:16:3e:2d:63:6a", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4f98b7-b1", "ovs_interfaceid": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "089a686b-763d-41df-b624-291933367593", "address": "fa:16:3e:28:ca:6e", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap089a686b-76", "ovs_interfaceid": "089a686b-763d-41df-b624-291933367593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96beb287-2181-4df4-b835-a9f071ace5df", "address": "fa:16:3e:a8:73:9b", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96beb287-21", "ovs_interfaceid": "96beb287-2181-4df4-b835-a9f071ace5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "address": "fa:16:3e:01:92:b8", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a4f2864-33", "ovs_interfaceid": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "address": "fa:16:3e:3a:52:8a", "network": {"id": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "bridge": "br-int", "label": "tempest-device-tagging-net2-696599136", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2904a0c-90", "ovs_interfaceid": "c2904a0c-904d-4dc3-9ffc-aaa05e253319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Detach interface failed, port_id=97d7d320-4ac2-41af-86ca-c30f00808f33, reason: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:15:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-deleted-c2904a0c-904d-4dc3-9ffc-aaa05e253319 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:21 user nova-compute[72019]: INFO nova.compute.manager [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Neutron deleted interface c2904a0c-904d-4dc3-9ffc-aaa05e253319; detaching it from the instance and deleting it from the info cache
Apr 14 13:15:21 user nova-compute[72019]: DEBUG nova.network.neutron [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating instance_info_cache with network_info: [{"id": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "address": "fa:16:3e:2d:63:6a", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4f98b7-b1", "ovs_interfaceid": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "089a686b-763d-41df-b624-291933367593", "address": "fa:16:3e:28:ca:6e", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap089a686b-76", "ovs_interfaceid": "089a686b-763d-41df-b624-291933367593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96beb287-2181-4df4-b835-a9f071ace5df", "address": "fa:16:3e:a8:73:9b", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96beb287-21", "ovs_interfaceid": "96beb287-2181-4df4-b835-a9f071ace5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "address": "fa:16:3e:01:92:b8", "network": {"id": "58be4554-9763-4268-a91d-165d6628185f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1461027664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c9b68596374d4b918a83f403f2f25143", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a4f2864-33", "ovs_interfaceid": "8a4f2864-33fc-4666-bb51-bdd01bc07af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Detach interface failed, port_id=c2904a0c-904d-4dc3-9ffc-aaa05e253319, reason: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:15:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 348127232 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 483393536 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:23 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 609222656 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:23 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:23 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Took 6.25 seconds to deallocate network for instance.
Apr 14 13:15:23 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 743440384 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-deleted-64455602-0478-47d7-9d50-551d552ceb26 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:23 user nova-compute[72019]: INFO nova.compute.manager [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Neutron deleted interface 64455602-0478-47d7-9d50-551d552ceb26; detaching it from the instance and deleting it from the info cache
Apr 14 13:15:23 user nova-compute[72019]: DEBUG nova.network.neutron [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating instance_info_cache with network_info: [{"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "address": "fa:16:3e:30:86:89", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3adf3c-41", "ovs_interfaceid": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "address": "fa:16:3e:50:00:be", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64a492-8e", "ovs_interfaceid": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Detach interface failed, port_id=64455602-0478-47d7-9d50-551d552ceb26, reason: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-deleted-96beb287-2181-4df4-b835-a9f071ace5df {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-deleted-3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:24 user nova-compute[72019]: INFO nova.compute.manager [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Neutron deleted interface 3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21; detaching it from the instance and deleting it from the info cache
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating instance_info_cache with network_info: [{"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "address": "fa:16:3e:50:00:be", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64a492-8e", "ovs_interfaceid": "ff64a492-8e97-4c11-9207-bf56011d8a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Detach interface failed, port_id=3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21, reason: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Received event network-vif-deleted-8a4f2864-33fc-4666-bb51-bdd01bc07af4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-deleted-ff64a492-8e97-4c11-9207-bf56011d8a5d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:24 user nova-compute[72019]: INFO nova.compute.manager [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Neutron deleted interface ff64a492-8e97-4c11-9207-bf56011d8a5d; detaching it from the instance and deleting it from the info cache
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating instance_info_cache with network_info: [{"id": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "address": "fa:16:3e:76:75:b1", "network": {"id": "7e198958-bf78-4f31-a37f-fcf4eb24caa8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1919763581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fef6c1f-75", "ovs_interfaceid": "4fef6c1f-75be-46b1-b091-f3717d65bb21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3532d3d6-73ac-40eb-9486-d70fac78c992", "address": "fa:16:3e:b0:95:fe", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3532d3d6-73", "ovs_interfaceid": "3532d3d6-73ac-40eb-9486-d70fac78c992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "address": "fa:16:3e:e5:92:cb", "network": {"id": "7396885f-54d3-4b44-93c3-6628072d667b", "bridge": "br-int", "label": "tempest-device-tagging-net1-304080742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3929e20e-3b", "ovs_interfaceid": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "address": "fa:16:3e:6c:db:85", "network": {"id": "51c39db2-b137-4dff-8993-3a97bb48e38a", "bridge": "br-int", "label": "tempest-device-tagging-net2-491025213", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16235c48e6fb4457bbd7edfa321929a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e63fe4d-bc", "ovs_interfaceid": "8e63fe4d-bc87-40cb-855e-ad82726ca39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Detach interface failed, port_id=ff64a492-8e97-4c11-9207-bf56011d8a5d, reason: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.objects.instance [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lazy-loading 'flavor' on Instance uuid 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:24 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Ignoring supplied device name: /dev/vdb
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 887095296 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:24 user nova-compute[72019]: INFO nova.compute.manager [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Attaching volume ecf06e30-17dc-45c5-9fb1-5db1599ef12d to /dev/vdb
Apr 14 13:15:24 user nova-compute[72019]: DEBUG os_brick.utils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f95d9ad-00ce-4084-9028-2ff27d6a73d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3c4edb-b716-462f-8ec9-c92438f38ec4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e87f2e8-5df0-494c-9a31-8da9e06053fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16a67de-548f-445c-998e-d5eaab6f57d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 1016070144 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:15:24 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:15:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[34474a3f-68dc-43d2-a0b3-548991f7ba5d]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG os_brick.utils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:24 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Updating existing volume attachment record: a5720a17-9c54-4ac5-9758-88ed56ae757c {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IecTLNEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '3bfe6502-3c9d-4714-a244-31792062ae86': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:25 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aff709-bf2a-4b65-a998-f160d580635a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:15:25 user nova-compute[72019]: No targets found.
Apr 14 13:15:25 user nova-compute[72019]: iSNS:
Apr 14 13:15:25 user nova-compute[72019]: No targets found.
Apr 14 13:15:25 user nova-compute[72019]: STATIC:
Apr 14 13:15:25 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:15:25 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:25 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:25 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86
Apr 14 13:15:25 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:25 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:25 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92
Apr 14 13:15:25 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:25 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:25 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:15:25 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:25 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:25 user nova-compute[72019]: FIRMWARE:
Apr 14 13:15:25 user nova-compute[72019]: No targets found.
Apr 14 13:15:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:15:25 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:15:25 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[806de749-63c1-41ea-8129-64bf026fbdeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c854ad7d-db3b-4c67-b7d9-b376b124d3fe]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:25 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:25 user nova-compute[72019]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:25 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:25 user nova-compute[72019]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 (non-flash)
Apr 14 13:15:25 user nova-compute[72019]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:25 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74905b4af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86'): ({'sdk'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Removing single pathed devices sdk {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Updating instance_info_cache with network_info: [{"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fc1551-a721-44b8-b3b2-8be3118c09a0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc1d971-281e-4bcb-83cb-41f57fa6c9e1]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Flushing IO for device /dev/sdk {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4818a6-a9ad-4f98-ba13-dc1ce5dcb19f]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.033s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a74a0f-45e3-4066-bf6d-25594fc8f715]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] SCSI volumes sdk have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c44002a-c356-46e9-b670-fb0583aae202]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:25 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Took 7.72 seconds to deallocate network for instance.
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f96446-5c3e-41cf-961c-d62bb446c3dd]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86, portal: 172.16.0.220,3260]
Apr 14 13:15:25 user nova-compute[72019]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bfe6502-3c9d-4714-a244-31792062ae86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c682f76d-7937-40cc-a576-ada1d26952f6]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] <== disconnect_volume: return (355ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:15:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-2c6f8d81-dce1-4d00-8ccc-d5ef1ad7003e req-8fa93427-405a-4259-b81e-8163ef246889 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-deleted-4fef6c1f-75be-46b1-b091-f3717d65bb21 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-2c6f8d81-dce1-4d00-8ccc-d5ef1ad7003e req-8fa93427-405a-4259-b81e-8163ef246889 service nova] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Received event network-vif-deleted-8e63fe4d-bc87-40cb-855e-ad82726ca39d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:26 user nova-compute[72019]: INFO nova.compute.manager [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Took 3.21 seconds to detach 3 volumes for instance.
Apr 14 13:15:26 user nova-compute[72019]: DEBUG nova.compute.manager [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwvDItlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '990b083b-744a-42cb-88f3-7ae16a5abed4', 'attached_at': '', 'detached_at': '', 'volume_id': '3ddfd1c1-8f03-4f07-a754-304e70750e92', 'serial'} {{(pid=72019) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG nova.compute.manager [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] swap_volume: removing Cinder connection for volume 3bfe6502-3c9d-4714-a244-31792062ae86 {{(pid=72019) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.610s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:27 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Deleted allocations for instance 7cf6ed7d-a98e-4984-967c-148e1537a118
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "7cf6ed7d-a98e-4984-967c-148e1537a118" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.951s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] swap_volume: Updating volume 3bfe6502-3c9d-4714-a244-31792062ae86 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "GwvDItlx", "auth_password": "DoAFKrR0l4SX8P", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "3ddfd1c1-8f03-4f07-a754-304e70750e92"}, "status": "reserved", "instance": "990b083b-744a-42cb-88f3-7ae16a5abed4", "attached_at": "", "detached_at": "", "volume_id": "3ddfd1c1-8f03-4f07-a754-304e70750e92", "serial": "3ddfd1c1-8f03-4f07-a754-304e70750e92"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3ddfd1c1-8f03-4f07-a754-304e70750e92', 'no_device': None, 'attachment_id': '32c291b3-2fd0-4d21-addd-4cb6e0f3be30'} {{(pid=72019) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.831s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "990b083b-744a-42cb-88f3-7ae16a5abed4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:28 user nova-compute[72019]: INFO nova.compute.manager [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Detaching volume 3ddfd1c1-8f03-4f07-a754-304e70750e92
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:28 user nova-compute[72019]: INFO nova.virt.block_device [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Attempting to driver detach volume 3ddfd1c1-8f03-4f07-a754-304e70750e92 from mountpoint /dev/vdb
Apr 14 13:15:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Attempting to detach device vdb from instance 990b083b-744a-42cb-88f3-7ae16a5abed4 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:15:28 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:15:28 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:15:28 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:15:28 user nova-compute[72019]:   <serial>3ddfd1c1-8f03-4f07-a754-304e70750e92</serial>
Apr 14 13:15:28 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:15:28 user nova-compute[72019]: </disk>
Apr 14 13:15:28 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:15:28 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Successfully detached device vdb from instance 990b083b-744a-42cb-88f3-7ae16a5abed4 from the persistent domain config.
Apr 14 13:15:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 990b083b-744a-42cb-88f3-7ae16a5abed4 from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:15:28 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:15:28 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:15:28 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:15:28 user nova-compute[72019]:   <serial>3ddfd1c1-8f03-4f07-a754-304e70750e92</serial>
Apr 14 13:15:28 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:15:28 user nova-compute[72019]: </disk>
Apr 14 13:15:28 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:15:28 user nova-compute[72019]: INFO nova.compute.manager [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Took 2.61 seconds to detach 3 volumes for instance.
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478128.7519076, 990b083b-744a-42cb-88f3-7ae16a5abed4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 990b083b-744a-42cb-88f3-7ae16a5abed4 {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:15:28 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Successfully detached device vdb from instance 990b083b-744a-42cb-88f3-7ae16a5abed4 from the live domain config.
Apr 14 13:15:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwvDItlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '3ddfd1c1-8f03-4f07-a754-304e70750e92': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:28 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[55552327-b9a6-48b4-8a51-f3b4b057cc97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:15:28 user nova-compute[72019]: No targets found.
Apr 14 13:15:28 user nova-compute[72019]: iSNS:
Apr 14 13:15:28 user nova-compute[72019]: No targets found.
Apr 14 13:15:28 user nova-compute[72019]: STATIC:
Apr 14 13:15:28 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:15:28 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:28 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:28 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92
Apr 14 13:15:28 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:28 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:28 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:15:28 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:28 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:28 user nova-compute[72019]: FIRMWARE:
Apr 14 13:15:28 user nova-compute[72019]: No targets found.
Apr 14 13:15:28 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:15:28 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:15:28 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b995a499-c4d8-4a7b-8b36-a326bf230b4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0868cf7-8fed-4827-a1a3-c74b2dbc7fc1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:28 user nova-compute[72019]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:28 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:28 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:28 user nova-compute[72019]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 (non-flash)
Apr 14 13:15:28 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:28 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7490779750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92'): ({'sdb'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Removing single pathed devices sdb {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf046bc0-bc30-4bff-a3f0-c369726dced7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2005bec9-8eb7-4588-bf9f-92a765234d43]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Flushing IO for device /dev/sdb {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2ff4f8-1372-4228-a723-66fd6d93b566]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:15:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bc79c4-95ea-4554-ab59-f28d62d90033]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.603s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ca5fcd-3e72-4a27-a769-d086be2b62ec]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:15:29 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Deleted allocations for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[db07a1db-af92-47bb-bf6c-8a64e663e4e8]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478114.3999352, 7cf6ed7d-a98e-4984-967c-148e1537a118 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:15:29 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] VM Stopped (Lifecycle Event)
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260]
Apr 14 13:15:29 user nova-compute[72019]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:29 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:29 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:15:29 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7737MB free_disk=26.462474822998047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.compute.manager [None req-9b8849a2-114b-4d20-b834-4f652724246b None None] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddfd1c1-8f03-4f07-a754-304e70750e92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[644adadd-2901-4b1c-a6b6-3bb03f4d3420]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.718s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] <== disconnect_volume: return (719ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.983s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance c74c3463-6701-4150-9096-1775785e8e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 990b083b-744a-42cb-88f3-7ae16a5abed4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqnlNyVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:29 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:29 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:29 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfefc6e-a7d2-48d1-afa9-72c24999637a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:15:29 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fd4e41-ed31-4dfd-8970-9b512acbe297]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d] added
Apr 14 13:15:29 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:15:29 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f721e61e-f086-43c5-9d73-8afadf5cf1c0]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1093d9-096d-4553-9f49-d45a22039f88]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mqnlNyVt {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mqnlNyVt" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d46d101-f9cf-423b-bd75-72c486aeb601]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mqnlNyVt'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f358e1-a1bb-4199-8d6c-7486899e10ac]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[edda6a90-d93b-452f-8b42-5a54ab00c164]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:30 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:30 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:30 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:30 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[282636d3-68c9-48c1-8530-94a68b3c57dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d, portal: 172.16.0.220,3260]
Apr 14 13:15:30 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:30 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35a5b48-383a-4b67-baa8-cd243a7d4f16]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8218d225-512d-4f9b-8cbd-fc5cfd84ba89]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:30 user nova-compute[72019]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d (non-flash)
Apr 14 13:15:30 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:30 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:30 user nova-compute[72019]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d (non-flash)
Apr 14 13:15:30 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:30 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[94885e27-6442-4b29-b395-ab40f224f55a]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG nova.objects.instance [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lazy-loading 'flavor' on Instance uuid 990b083b-744a-42cb-88f3-7ae16a5abed4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.212s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:31 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:15:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqnlNyVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:15:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23632306436306262', 'path': '/dev/sdb'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632306436306262', 'path': '/dev/sdb'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:15:31 user nova-compute[72019]: DEBUG nova.objects.instance [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lazy-loading 'flavor' on Instance uuid 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:15:31 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:15:31 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:15:31 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:15:31 user nova-compute[72019]:   <serial>ecf06e30-17dc-45c5-9fb1-5db1599ef12d</serial>
Apr 14 13:15:31 user nova-compute[72019]: </disk>
Apr 14 13:15:31 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:15:31 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478116.4179568, 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:15:31 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] VM Stopped (Lifecycle Event)
Apr 14 13:15:31 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6524fd98-e900-44c5-947d-f7a08ea9187d None None] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:15:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:15:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:15:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] No VIF found with MAC fa:16:3e:29:90:2f, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:15:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.258s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:15:38 user nova-compute[72019]: INFO nova.compute.claims [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Claim successful on node user
Apr 14 13:15:38 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG nova.compute.manager [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:15:38 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:15:38 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:15:38 user nova-compute[72019]: INFO nova.compute.claims [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Claim successful on node user
Apr 14 13:15:38 user nova-compute[72019]: DEBUG nova.policy [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '065f23d461f44751a6911adcd3124fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b733f664b340e289c562e19ebd28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:15:38 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Creating image(s)
Apr 14 13:15:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "/opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "/opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "/opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.158s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.164s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk 1073741824" returned: 0 in 0.050s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.175s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.network.neutron [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:15:39 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Cannot resize image /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'migration_context' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Ensure instance console log exists: /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:15:39 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Creating image(s)
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "/opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "/opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Successfully created port: 965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG nova.policy [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c4166b50a7c49158acc8684eaee6041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7d361867b4265bd4e1d13e9e66bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk 1073741824" returned: 0 in 0.057s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.133s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:40 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:15:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:40 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Cannot resize image /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:15:40 user nova-compute[72019]: DEBUG nova.objects.instance [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lazy-loading 'migration_context' on Instance uuid bb40ccf2-2c37-46ff-be3d-242dc69d0655 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:15:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Ensure instance console log exists: /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:15:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.network.neutron [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Successfully created port: 8cb2e08e-e795-4c9f-ac2c-e249116ef595 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Successfully updated port: 965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquired lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-6d4bdcff-5dfc-436c-af73-ac56080a1f0a req-679ff8c9-c3c2-4325-8722-4bb3636aa29d service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-changed-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-6d4bdcff-5dfc-436c-af73-ac56080a1f0a req-679ff8c9-c3c2-4325-8722-4bb3636aa29d service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Refreshing instance network info cache due to event network-changed-965f15ad-1141-41f1-b9f3-41097bb21b5e. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6d4bdcff-5dfc-436c-af73-ac56080a1f0a req-679ff8c9-c3c2-4325-8722-4bb3636aa29d service nova] Acquiring lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Updating instance_info_cache with network_info: [{"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Releasing lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Instance network_info: |[{"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6d4bdcff-5dfc-436c-af73-ac56080a1f0a req-679ff8c9-c3c2-4325-8722-4bb3636aa29d service nova] Acquired lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.network.neutron [req-6d4bdcff-5dfc-436c-af73-ac56080a1f0a req-679ff8c9-c3c2-4325-8722-4bb3636aa29d service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Refreshing network info cache for port 965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Start _get_guest_xml network_info=[{"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:15:41 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:15:41 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-450055877',display_name='tempest-ServerStableDeviceRescueTest-server-450055877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-450055877',id=15,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjseCXo591Ib7m2QQg2YUiEmBpT41KO6pBZujMk3kb1ezcLxBJnhodHUloea6z3H0OhTIU/PPnS5Viw3M1jYSulnA0hMkrnmWEGu58Pu2ctSWI3CS0ih18sa0sVBubY/Q==',key_name='tempest-keypair-1253237269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b733f664b340e289c562e19ebd28c3',ramdisk_id='',reservation_id='r-t3f59y77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-583958040',owner_user_name='tempest-ServerStableDeviceRescueTest-583958040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:15:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='065f23d461f44751a6911adcd3124fe9',uuid=65e98ad1-3573-4dce-b9de-bbb1c36ed02e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Converting VIF {"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=965f15ad-1141-41f1-b9f3-41097bb21b5e,network=Network(1791e209-7b0c-4262-a342-ed1523633f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965f15ad-11') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'pci_devices' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:15:41 user nova-compute[72019]:   <uuid>65e98ad1-3573-4dce-b9de-bbb1c36ed02e</uuid>
Apr 14 13:15:41 user nova-compute[72019]:   <name>instance-0000000f</name>
Apr 14 13:15:41 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:15:41 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:15:41 user nova-compute[72019]:   <metadata>
Apr 14 13:15:41 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:15:41 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:15:41 user nova-compute[72019]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-450055877</nova:name>
Apr 14 13:15:41 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:15:41</nova:creationTime>
Apr 14 13:15:41 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:15:41 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:15:41 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:15:41 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:15:41 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:15:41 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:15:41 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:15:41 user nova-compute[72019]:       <nova:owner>
Apr 14 13:15:41 user nova-compute[72019]:         <nova:user uuid="065f23d461f44751a6911adcd3124fe9">tempest-ServerStableDeviceRescueTest-583958040-project-member</nova:user>
Apr 14 13:15:41 user nova-compute[72019]:         <nova:project uuid="76b733f664b340e289c562e19ebd28c3">tempest-ServerStableDeviceRescueTest-583958040</nova:project>
Apr 14 13:15:41 user nova-compute[72019]:       </nova:owner>
Apr 14 13:15:41 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:15:41 user nova-compute[72019]:       <nova:ports>
Apr 14 13:15:41 user nova-compute[72019]:         <nova:port uuid="965f15ad-1141-41f1-b9f3-41097bb21b5e">
Apr 14 13:15:41 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 13:15:41 user nova-compute[72019]:         </nova:port>
Apr 14 13:15:41 user nova-compute[72019]:       </nova:ports>
Apr 14 13:15:41 user nova-compute[72019]:     </nova:instance>
Apr 14 13:15:41 user nova-compute[72019]:   </metadata>
Apr 14 13:15:41 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:15:41 user nova-compute[72019]:     <system>
Apr 14 13:15:41 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:15:41 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:15:41 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:15:41 user nova-compute[72019]:       <entry name="serial">65e98ad1-3573-4dce-b9de-bbb1c36ed02e</entry>
Apr 14 13:15:41 user nova-compute[72019]:       <entry name="uuid">65e98ad1-3573-4dce-b9de-bbb1c36ed02e</entry>
Apr 14 13:15:41 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:15:41 user nova-compute[72019]:     </system>
Apr 14 13:15:41 user nova-compute[72019]:   </sysinfo>
Apr 14 13:15:41 user nova-compute[72019]:   <os>
Apr 14 13:15:41 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:15:41 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:15:41 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:15:41 user nova-compute[72019]:   </os>
Apr 14 13:15:41 user nova-compute[72019]:   <features>
Apr 14 13:15:41 user nova-compute[72019]:     <acpi/>
Apr 14 13:15:41 user nova-compute[72019]:     <apic/>
Apr 14 13:15:41 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:15:41 user nova-compute[72019]:   </features>
Apr 14 13:15:41 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:15:41 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:15:41 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:15:41 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:15:41 user nova-compute[72019]:   </clock>
Apr 14 13:15:41 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:15:41 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:15:41 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:15:41 user nova-compute[72019]:   </cpu>
Apr 14 13:15:41 user nova-compute[72019]:   <devices>
Apr 14 13:15:41 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:15:41 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:15:41 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk"/>
Apr 14 13:15:41 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:15:41 user nova-compute[72019]:     </disk>
Apr 14 13:15:41 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:15:41 user nova-compute[72019]:       <mac address="fa:16:3e:79:ac:fd"/>
Apr 14 13:15:41 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:15:41 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:15:41 user nova-compute[72019]:       <target dev="tap965f15ad-11"/>
Apr 14 13:15:41 user nova-compute[72019]:     </interface>
Apr 14 13:15:41 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:15:41 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/console.log" append="off"/>
Apr 14 13:15:41 user nova-compute[72019]:     </serial>
Apr 14 13:15:41 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:15:41 user nova-compute[72019]:     <video>
Apr 14 13:15:41 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:15:41 user nova-compute[72019]:     </video>
Apr 14 13:15:41 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:15:41 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:15:41 user nova-compute[72019]:     </rng>
Apr 14 13:15:41 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:15:41 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:15:41 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:15:41 user nova-compute[72019]:     </memballoon>
Apr 14 13:15:41 user nova-compute[72019]:   </devices>
Apr 14 13:15:41 user nova-compute[72019]: </domain>
Apr 14 13:15:41 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-450055877',display_name='tempest-ServerStableDeviceRescueTest-server-450055877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-450055877',id=15,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjseCXo591Ib7m2QQg2YUiEmBpT41KO6pBZujMk3kb1ezcLxBJnhodHUloea6z3H0OhTIU/PPnS5Viw3M1jYSulnA0hMkrnmWEGu58Pu2ctSWI3CS0ih18sa0sVBubY/Q==',key_name='tempest-keypair-1253237269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76b733f664b340e289c562e19ebd28c3',ramdisk_id='',reservation_id='r-t3f59y77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-583958040',owner_user_name='tempest-ServerStableDeviceRescueTest-583958040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:15:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='065f23d461f44751a6911adcd3124fe9',uuid=65e98ad1-3573-4dce-b9de-bbb1c36ed02e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Converting VIF {"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=965f15ad-1141-41f1-b9f3-41097bb21b5e,network=Network(1791e209-7b0c-4262-a342-ed1523633f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965f15ad-11') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG os_vif [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=965f15ad-1141-41f1-b9f3-41097bb21b5e,network=Network(1791e209-7b0c-4262-a342-ed1523633f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965f15ad-11') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap965f15ad-11, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap965f15ad-11, col_values=(('external_ids', {'iface-id': '965f15ad-1141-41f1-b9f3-41097bb21b5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:ac:fd', 'vm-uuid': '65e98ad1-3573-4dce-b9de-bbb1c36ed02e'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:41 user nova-compute[72019]: INFO os_vif [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=965f15ad-1141-41f1-b9f3-41097bb21b5e,network=Network(1791e209-7b0c-4262-a342-ed1523633f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965f15ad-11')
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:15:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] No VIF found with MAC fa:16:3e:79:ac:fd, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.network.neutron [req-6d4bdcff-5dfc-436c-af73-ac56080a1f0a req-679ff8c9-c3c2-4325-8722-4bb3636aa29d service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Updated VIF entry in instance network info cache for port 965f15ad-1141-41f1-b9f3-41097bb21b5e. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.network.neutron [req-6d4bdcff-5dfc-436c-af73-ac56080a1f0a req-679ff8c9-c3c2-4325-8722-4bb3636aa29d service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Updating instance_info_cache with network_info: [{"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.network.neutron [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Successfully updated port: 8cb2e08e-e795-4c9f-ac2c-e249116ef595 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6d4bdcff-5dfc-436c-af73-ac56080a1f0a req-679ff8c9-c3c2-4325-8722-4bb3636aa29d service nova] Releasing lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "refresh_cache-bb40ccf2-2c37-46ff-be3d-242dc69d0655" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquired lock "refresh_cache-bb40ccf2-2c37-46ff-be3d-242dc69d0655" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.network.neutron [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.network.neutron [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.network.neutron [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Updating instance_info_cache with network_info: [{"id": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "address": "fa:16:3e:d8:b4:9a", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb2e08e-e7", "ovs_interfaceid": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Releasing lock "refresh_cache-bb40ccf2-2c37-46ff-be3d-242dc69d0655" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Instance network_info: |[{"id": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "address": "fa:16:3e:d8:b4:9a", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb2e08e-e7", "ovs_interfaceid": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Start _get_guest_xml network_info=[{"id": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "address": "fa:16:3e:d8:b4:9a", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb2e08e-e7", "ovs_interfaceid": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:15:42 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:15:42 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:15:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1313042541',display_name='tempest-VolumesActionsTest-instance-1313042541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1313042541',id=16,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1c7d361867b4265bd4e1d13e9e66bc4',ramdisk_id='',reservation_id='r-0i6him55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2125520108',owner_user_name='tempest-VolumesActionsTest-2125520108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:15:40Z,user_data=None,user_id='1c4166b50a7c49158acc8684eaee6041',uuid=bb40ccf2-2c37-46ff-be3d-242dc69d0655,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "address": "fa:16:3e:d8:b4:9a", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb2e08e-e7", "ovs_interfaceid": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Converting VIF {"id": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "address": "fa:16:3e:d8:b4:9a", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb2e08e-e7", "ovs_interfaceid": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb2e08e-e795-4c9f-ac2c-e249116ef595,network=Network(c6dfe7b8-e16e-4c31-93b7-9e358f72de7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb2e08e-e7') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.objects.instance [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lazy-loading 'pci_devices' on Instance uuid bb40ccf2-2c37-46ff-be3d-242dc69d0655 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:15:42 user nova-compute[72019]:   <uuid>bb40ccf2-2c37-46ff-be3d-242dc69d0655</uuid>
Apr 14 13:15:42 user nova-compute[72019]:   <name>instance-00000010</name>
Apr 14 13:15:42 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:15:42 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:15:42 user nova-compute[72019]:   <metadata>
Apr 14 13:15:42 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:15:42 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:15:42 user nova-compute[72019]:       <nova:name>tempest-VolumesActionsTest-instance-1313042541</nova:name>
Apr 14 13:15:42 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:15:42</nova:creationTime>
Apr 14 13:15:42 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:15:42 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:15:42 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:15:42 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:15:42 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:15:42 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:15:42 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:15:42 user nova-compute[72019]:       <nova:owner>
Apr 14 13:15:42 user nova-compute[72019]:         <nova:user uuid="1c4166b50a7c49158acc8684eaee6041">tempest-VolumesActionsTest-2125520108-project-member</nova:user>
Apr 14 13:15:42 user nova-compute[72019]:         <nova:project uuid="e1c7d361867b4265bd4e1d13e9e66bc4">tempest-VolumesActionsTest-2125520108</nova:project>
Apr 14 13:15:42 user nova-compute[72019]:       </nova:owner>
Apr 14 13:15:42 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:15:42 user nova-compute[72019]:       <nova:ports>
Apr 14 13:15:42 user nova-compute[72019]:         <nova:port uuid="8cb2e08e-e795-4c9f-ac2c-e249116ef595">
Apr 14 13:15:42 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 13:15:42 user nova-compute[72019]:         </nova:port>
Apr 14 13:15:42 user nova-compute[72019]:       </nova:ports>
Apr 14 13:15:42 user nova-compute[72019]:     </nova:instance>
Apr 14 13:15:42 user nova-compute[72019]:   </metadata>
Apr 14 13:15:42 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:15:42 user nova-compute[72019]:     <system>
Apr 14 13:15:42 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:15:42 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:15:42 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:15:42 user nova-compute[72019]:       <entry name="serial">bb40ccf2-2c37-46ff-be3d-242dc69d0655</entry>
Apr 14 13:15:42 user nova-compute[72019]:       <entry name="uuid">bb40ccf2-2c37-46ff-be3d-242dc69d0655</entry>
Apr 14 13:15:42 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:15:42 user nova-compute[72019]:     </system>
Apr 14 13:15:42 user nova-compute[72019]:   </sysinfo>
Apr 14 13:15:42 user nova-compute[72019]:   <os>
Apr 14 13:15:42 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:15:42 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:15:42 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:15:42 user nova-compute[72019]:   </os>
Apr 14 13:15:42 user nova-compute[72019]:   <features>
Apr 14 13:15:42 user nova-compute[72019]:     <acpi/>
Apr 14 13:15:42 user nova-compute[72019]:     <apic/>
Apr 14 13:15:42 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:15:42 user nova-compute[72019]:   </features>
Apr 14 13:15:42 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:15:42 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:15:42 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:15:42 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:15:42 user nova-compute[72019]:   </clock>
Apr 14 13:15:42 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:15:42 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:15:42 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:15:42 user nova-compute[72019]:   </cpu>
Apr 14 13:15:42 user nova-compute[72019]:   <devices>
Apr 14 13:15:42 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:15:42 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:15:42 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk"/>
Apr 14 13:15:42 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:15:42 user nova-compute[72019]:     </disk>
Apr 14 13:15:42 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:15:42 user nova-compute[72019]:       <mac address="fa:16:3e:d8:b4:9a"/>
Apr 14 13:15:42 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:15:42 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:15:42 user nova-compute[72019]:       <target dev="tap8cb2e08e-e7"/>
Apr 14 13:15:42 user nova-compute[72019]:     </interface>
Apr 14 13:15:42 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:15:42 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/console.log" append="off"/>
Apr 14 13:15:42 user nova-compute[72019]:     </serial>
Apr 14 13:15:42 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:15:42 user nova-compute[72019]:     <video>
Apr 14 13:15:42 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:15:42 user nova-compute[72019]:     </video>
Apr 14 13:15:42 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:15:42 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:15:42 user nova-compute[72019]:     </rng>
Apr 14 13:15:42 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:15:42 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:15:42 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:15:42 user nova-compute[72019]:     </memballoon>
Apr 14 13:15:42 user nova-compute[72019]:   </devices>
Apr 14 13:15:42 user nova-compute[72019]: </domain>
Apr 14 13:15:42 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:15:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1313042541',display_name='tempest-VolumesActionsTest-instance-1313042541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1313042541',id=16,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1c7d361867b4265bd4e1d13e9e66bc4',ramdisk_id='',reservation_id='r-0i6him55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2125520108',owner_user_name='tempest-VolumesActionsTest-2125520108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:15:40Z,user_data=None,user_id='1c4166b50a7c49158acc8684eaee6041',uuid=bb40ccf2-2c37-46ff-be3d-242dc69d0655,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "address": "fa:16:3e:d8:b4:9a", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb2e08e-e7", "ovs_interfaceid": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Converting VIF {"id": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "address": "fa:16:3e:d8:b4:9a", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb2e08e-e7", "ovs_interfaceid": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb2e08e-e795-4c9f-ac2c-e249116ef595,network=Network(c6dfe7b8-e16e-4c31-93b7-9e358f72de7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb2e08e-e7') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG os_vif [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb2e08e-e795-4c9f-ac2c-e249116ef595,network=Network(c6dfe7b8-e16e-4c31-93b7-9e358f72de7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb2e08e-e7') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cb2e08e-e7, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8cb2e08e-e7, col_values=(('external_ids', {'iface-id': '8cb2e08e-e795-4c9f-ac2c-e249116ef595', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:b4:9a', 'vm-uuid': 'bb40ccf2-2c37-46ff-be3d-242dc69d0655'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:42 user nova-compute[72019]: INFO os_vif [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb2e08e-e795-4c9f-ac2c-e249116ef595,network=Network(c6dfe7b8-e16e-4c31-93b7-9e358f72de7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb2e08e-e7')
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:15:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] No VIF found with MAC fa:16:3e:d8:b4:9a, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-a33fc2e0-c54f-4b71-9f90-a6824105ea61 req-827b4fc0-70e7-42fa-80e9-db50a07ac8e4 service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Received event network-changed-8cb2e08e-e795-4c9f-ac2c-e249116ef595 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-a33fc2e0-c54f-4b71-9f90-a6824105ea61 req-827b4fc0-70e7-42fa-80e9-db50a07ac8e4 service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Refreshing instance network info cache due to event network-changed-8cb2e08e-e795-4c9f-ac2c-e249116ef595. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a33fc2e0-c54f-4b71-9f90-a6824105ea61 req-827b4fc0-70e7-42fa-80e9-db50a07ac8e4 service nova] Acquiring lock "refresh_cache-bb40ccf2-2c37-46ff-be3d-242dc69d0655" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a33fc2e0-c54f-4b71-9f90-a6824105ea61 req-827b4fc0-70e7-42fa-80e9-db50a07ac8e4 service nova] Acquired lock "refresh_cache-bb40ccf2-2c37-46ff-be3d-242dc69d0655" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG nova.network.neutron [req-a33fc2e0-c54f-4b71-9f90-a6824105ea61 req-827b4fc0-70e7-42fa-80e9-db50a07ac8e4 service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Refreshing network info cache for port 8cb2e08e-e795-4c9f-ac2c-e249116ef595 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-4498ee46-5694-4dac-92e3-48084f0312e7 req-356644f6-37b9-4dd7-bec0-d95d23704e5a service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4498ee46-5694-4dac-92e3-48084f0312e7 req-356644f6-37b9-4dd7-bec0-d95d23704e5a service nova] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4498ee46-5694-4dac-92e3-48084f0312e7 req-356644f6-37b9-4dd7-bec0-d95d23704e5a service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4498ee46-5694-4dac-92e3-48084f0312e7 req-356644f6-37b9-4dd7-bec0-d95d23704e5a service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-4498ee46-5694-4dac-92e3-48084f0312e7 req-356644f6-37b9-4dd7-bec0-d95d23704e5a service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] No waiting events found dispatching network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:43 user nova-compute[72019]: WARNING nova.compute.manager [req-4498ee46-5694-4dac-92e3-48084f0312e7 req-356644f6-37b9-4dd7-bec0-d95d23704e5a service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received unexpected event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e for instance with vm_state building and task_state spawning.
Apr 14 13:15:43 user nova-compute[72019]: DEBUG nova.network.neutron [req-a33fc2e0-c54f-4b71-9f90-a6824105ea61 req-827b4fc0-70e7-42fa-80e9-db50a07ac8e4 service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Updated VIF entry in instance network info cache for port 8cb2e08e-e795-4c9f-ac2c-e249116ef595. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG nova.network.neutron [req-a33fc2e0-c54f-4b71-9f90-a6824105ea61 req-827b4fc0-70e7-42fa-80e9-db50a07ac8e4 service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Updating instance_info_cache with network_info: [{"id": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "address": "fa:16:3e:d8:b4:9a", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb2e08e-e7", "ovs_interfaceid": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a33fc2e0-c54f-4b71-9f90-a6824105ea61 req-827b4fc0-70e7-42fa-80e9-db50a07ac8e4 service nova] Releasing lock "refresh_cache-bb40ccf2-2c37-46ff-be3d-242dc69d0655" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:45 user nova-compute[72019]: DEBUG nova.compute.manager [req-344ba26a-b5b8-4541-94cd-c22c6b3a4e25 req-031853b4-e991-4260-82f4-c62608ca402b service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Received event network-vif-plugged-8cb2e08e-e795-4c9f-ac2c-e249116ef595 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-344ba26a-b5b8-4541-94cd-c22c6b3a4e25 req-031853b4-e991-4260-82f4-c62608ca402b service nova] Acquiring lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-344ba26a-b5b8-4541-94cd-c22c6b3a4e25 req-031853b4-e991-4260-82f4-c62608ca402b service nova] Lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-344ba26a-b5b8-4541-94cd-c22c6b3a4e25 req-031853b4-e991-4260-82f4-c62608ca402b service nova] Lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:45 user nova-compute[72019]: DEBUG nova.compute.manager [req-344ba26a-b5b8-4541-94cd-c22c6b3a4e25 req-031853b4-e991-4260-82f4-c62608ca402b service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] No waiting events found dispatching network-vif-plugged-8cb2e08e-e795-4c9f-ac2c-e249116ef595 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:45 user nova-compute[72019]: WARNING nova.compute.manager [req-344ba26a-b5b8-4541-94cd-c22c6b3a4e25 req-031853b4-e991-4260-82f4-c62608ca402b service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Received unexpected event network-vif-plugged-8cb2e08e-e795-4c9f-ac2c-e249116ef595 for instance with vm_state building and task_state spawning.
Apr 14 13:15:45 user nova-compute[72019]: DEBUG nova.compute.manager [req-0158e060-8926-4df4-97e0-046ca2791b57 req-26759904-d9f0-4310-b111-6fc7026fd427 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0158e060-8926-4df4-97e0-046ca2791b57 req-26759904-d9f0-4310-b111-6fc7026fd427 service nova] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0158e060-8926-4df4-97e0-046ca2791b57 req-26759904-d9f0-4310-b111-6fc7026fd427 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0158e060-8926-4df4-97e0-046ca2791b57 req-26759904-d9f0-4310-b111-6fc7026fd427 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:45 user nova-compute[72019]: DEBUG nova.compute.manager [req-0158e060-8926-4df4-97e0-046ca2791b57 req-26759904-d9f0-4310-b111-6fc7026fd427 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] No waiting events found dispatching network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:45 user nova-compute[72019]: WARNING nova.compute.manager [req-0158e060-8926-4df4-97e0-046ca2791b57 req-26759904-d9f0-4310-b111-6fc7026fd427 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received unexpected event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e for instance with vm_state building and task_state spawning.
Apr 14 13:15:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478146.4799793, 65e98ad1-3573-4dce-b9de-bbb1c36ed02e => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:15:46 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] VM Resumed (Lifecycle Event)
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:15:46 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Instance spawned successfully.
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:46 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478146.4820178, 65e98ad1-3573-4dce-b9de-bbb1c36ed02e => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:15:46 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] VM Started (Lifecycle Event)
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:15:46 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:15:46 user nova-compute[72019]: INFO nova.compute.manager [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Took 7.78 seconds to spawn the instance on the hypervisor.
Apr 14 13:15:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:15:46 user nova-compute[72019]: INFO nova.compute.manager [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Took 8.55 seconds to build instance.
Apr 14 13:15:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.648s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478147.0115595, bb40ccf2-2c37-46ff-be3d-242dc69d0655 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:15:47 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] VM Resumed (Lifecycle Event)
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:15:47 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Instance spawned successfully.
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:47 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478147.012526, bb40ccf2-2c37-46ff-be3d-242dc69d0655 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:15:47 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] VM Started (Lifecycle Event)
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:15:47 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:15:47 user nova-compute[72019]: INFO nova.compute.manager [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Took 7.43 seconds to spawn the instance on the hypervisor.
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:15:47 user nova-compute[72019]: INFO nova.compute.manager [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Took 8.45 seconds to build instance.
Apr 14 13:15:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.551s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-d3d8f4d3-cc3d-40ef-b8c8-9a2f570d752c req-b196650b-ab20-4ae4-b303-8a340969cc5a service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Received event network-vif-plugged-8cb2e08e-e795-4c9f-ac2c-e249116ef595 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d3d8f4d3-cc3d-40ef-b8c8-9a2f570d752c req-b196650b-ab20-4ae4-b303-8a340969cc5a service nova] Acquiring lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d3d8f4d3-cc3d-40ef-b8c8-9a2f570d752c req-b196650b-ab20-4ae4-b303-8a340969cc5a service nova] Lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d3d8f4d3-cc3d-40ef-b8c8-9a2f570d752c req-b196650b-ab20-4ae4-b303-8a340969cc5a service nova] Lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-d3d8f4d3-cc3d-40ef-b8c8-9a2f570d752c req-b196650b-ab20-4ae4-b303-8a340969cc5a service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] No waiting events found dispatching network-vif-plugged-8cb2e08e-e795-4c9f-ac2c-e249116ef595 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:47 user nova-compute[72019]: WARNING nova.compute.manager [req-d3d8f4d3-cc3d-40ef-b8c8-9a2f570d752c req-b196650b-ab20-4ae4-b303-8a340969cc5a service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Received unexpected event network-vif-plugged-8cb2e08e-e795-4c9f-ac2c-e249116ef595 for instance with vm_state active and task_state None.
Apr 14 13:15:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "8b5d7047-087e-44f4-b977-12c719f5a302" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "8b5d7047-087e-44f4-b977-12c719f5a302" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:50 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:15:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:15:50 user nova-compute[72019]: INFO nova.compute.claims [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Claim successful on node user
Apr 14 13:15:50 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:15:50 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:15:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:50 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:15:50 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:15:50 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:15:50 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:15:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG nova.policy [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1387c0adbe74072b52886ddc2af4182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9094bc9720194f02abdc6d0b081c7e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:15:51 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Creating image(s)
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "/opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "/opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.179s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.156s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk 1073741824" returned: 0 in 0.056s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Successfully created port: bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.152s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Cannot resize image /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:15:51 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lazy-loading 'migration_context' on Instance uuid 8b5d7047-087e-44f4-b977-12c719f5a302 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Ensure instance console log exists: /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Successfully updated port: bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "refresh_cache-8b5d7047-087e-44f4-b977-12c719f5a302" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquired lock "refresh_cache-8b5d7047-087e-44f4-b977-12c719f5a302" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.compute.manager [req-f1033db3-7991-4c0c-b832-101d6414f877 req-1e49cc21-dccc-463e-90c1-dc3e7c701405 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received event network-changed-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.compute.manager [req-f1033db3-7991-4c0c-b832-101d6414f877 req-1e49cc21-dccc-463e-90c1-dc3e7c701405 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Refreshing instance network info cache due to event network-changed-bc9a4ea0-414f-43d8-995a-edb489f1b810. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f1033db3-7991-4c0c-b832-101d6414f877 req-1e49cc21-dccc-463e-90c1-dc3e7c701405 service nova] Acquiring lock "refresh_cache-8b5d7047-087e-44f4-b977-12c719f5a302" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Updating instance_info_cache with network_info: [{"id": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "address": "fa:16:3e:72:48:35", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9a4ea0-41", "ovs_interfaceid": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Releasing lock "refresh_cache-8b5d7047-087e-44f4-b977-12c719f5a302" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Instance network_info: |[{"id": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "address": "fa:16:3e:72:48:35", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9a4ea0-41", "ovs_interfaceid": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f1033db3-7991-4c0c-b832-101d6414f877 req-1e49cc21-dccc-463e-90c1-dc3e7c701405 service nova] Acquired lock "refresh_cache-8b5d7047-087e-44f4-b977-12c719f5a302" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.network.neutron [req-f1033db3-7991-4c0c-b832-101d6414f877 req-1e49cc21-dccc-463e-90c1-dc3e7c701405 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Refreshing network info cache for port bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Start _get_guest_xml network_info=[{"id": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "address": "fa:16:3e:72:48:35", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9a4ea0-41", "ovs_interfaceid": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:15:52 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:15:52 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:15:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-652713944',display_name='tempest-VolumesAdminNegativeTest-server-652713944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-652713944',id=17,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9094bc9720194f02abdc6d0b081c7e32',ramdisk_id='',reservation_id='r-jiqs1cwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1303459042',owner_user_name='tempest-VolumesAdminNegativeTest-1303459042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:15:51Z,user_data=None,user_id='f1387c0adbe74072b52886ddc2af4182',uuid=8b5d7047-087e-44f4-b977-12c719f5a302,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "address": "fa:16:3e:72:48:35", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9a4ea0-41", "ovs_interfaceid": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Converting VIF {"id": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "address": "fa:16:3e:72:48:35", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9a4ea0-41", "ovs_interfaceid": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:35,bridge_name='br-int',has_traffic_filtering=True,id=bc9a4ea0-414f-43d8-995a-edb489f1b810,network=Network(ac0fadd7-d406-42a9-84c3-72fcfa33dc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9a4ea0-41') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b5d7047-087e-44f4-b977-12c719f5a302 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:15:52 user nova-compute[72019]:   <uuid>8b5d7047-087e-44f4-b977-12c719f5a302</uuid>
Apr 14 13:15:52 user nova-compute[72019]:   <name>instance-00000011</name>
Apr 14 13:15:52 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:15:52 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:15:52 user nova-compute[72019]:   <metadata>
Apr 14 13:15:52 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:15:52 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:15:52 user nova-compute[72019]:       <nova:name>tempest-VolumesAdminNegativeTest-server-652713944</nova:name>
Apr 14 13:15:52 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:15:52</nova:creationTime>
Apr 14 13:15:52 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:15:52 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:15:52 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:15:52 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:15:52 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:15:52 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:15:52 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:15:52 user nova-compute[72019]:       <nova:owner>
Apr 14 13:15:52 user nova-compute[72019]:         <nova:user uuid="f1387c0adbe74072b52886ddc2af4182">tempest-VolumesAdminNegativeTest-1303459042-project-member</nova:user>
Apr 14 13:15:52 user nova-compute[72019]:         <nova:project uuid="9094bc9720194f02abdc6d0b081c7e32">tempest-VolumesAdminNegativeTest-1303459042</nova:project>
Apr 14 13:15:52 user nova-compute[72019]:       </nova:owner>
Apr 14 13:15:52 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:15:52 user nova-compute[72019]:       <nova:ports>
Apr 14 13:15:52 user nova-compute[72019]:         <nova:port uuid="bc9a4ea0-414f-43d8-995a-edb489f1b810">
Apr 14 13:15:52 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 13:15:52 user nova-compute[72019]:         </nova:port>
Apr 14 13:15:52 user nova-compute[72019]:       </nova:ports>
Apr 14 13:15:52 user nova-compute[72019]:     </nova:instance>
Apr 14 13:15:52 user nova-compute[72019]:   </metadata>
Apr 14 13:15:52 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:15:52 user nova-compute[72019]:     <system>
Apr 14 13:15:52 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:15:52 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:15:52 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:15:52 user nova-compute[72019]:       <entry name="serial">8b5d7047-087e-44f4-b977-12c719f5a302</entry>
Apr 14 13:15:52 user nova-compute[72019]:       <entry name="uuid">8b5d7047-087e-44f4-b977-12c719f5a302</entry>
Apr 14 13:15:52 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:15:52 user nova-compute[72019]:     </system>
Apr 14 13:15:52 user nova-compute[72019]:   </sysinfo>
Apr 14 13:15:52 user nova-compute[72019]:   <os>
Apr 14 13:15:52 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:15:52 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:15:52 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:15:52 user nova-compute[72019]:   </os>
Apr 14 13:15:52 user nova-compute[72019]:   <features>
Apr 14 13:15:52 user nova-compute[72019]:     <acpi/>
Apr 14 13:15:52 user nova-compute[72019]:     <apic/>
Apr 14 13:15:52 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:15:52 user nova-compute[72019]:   </features>
Apr 14 13:15:52 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:15:52 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:15:52 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:15:52 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:15:52 user nova-compute[72019]:   </clock>
Apr 14 13:15:52 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:15:52 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:15:52 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:15:52 user nova-compute[72019]:   </cpu>
Apr 14 13:15:52 user nova-compute[72019]:   <devices>
Apr 14 13:15:52 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:15:52 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:15:52 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk"/>
Apr 14 13:15:52 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:15:52 user nova-compute[72019]:     </disk>
Apr 14 13:15:52 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:15:52 user nova-compute[72019]:       <mac address="fa:16:3e:72:48:35"/>
Apr 14 13:15:52 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:15:52 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:15:52 user nova-compute[72019]:       <target dev="tapbc9a4ea0-41"/>
Apr 14 13:15:52 user nova-compute[72019]:     </interface>
Apr 14 13:15:52 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:15:52 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/console.log" append="off"/>
Apr 14 13:15:52 user nova-compute[72019]:     </serial>
Apr 14 13:15:52 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:15:52 user nova-compute[72019]:     <video>
Apr 14 13:15:52 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:15:52 user nova-compute[72019]:     </video>
Apr 14 13:15:52 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:15:52 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:15:52 user nova-compute[72019]:     </rng>
Apr 14 13:15:52 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:15:52 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:15:52 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:15:52 user nova-compute[72019]:     </memballoon>
Apr 14 13:15:52 user nova-compute[72019]:   </devices>
Apr 14 13:15:52 user nova-compute[72019]: </domain>
Apr 14 13:15:52 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:15:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-652713944',display_name='tempest-VolumesAdminNegativeTest-server-652713944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-652713944',id=17,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9094bc9720194f02abdc6d0b081c7e32',ramdisk_id='',reservation_id='r-jiqs1cwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1303459042',owner_user_name='tempest-VolumesAdminNegativeTest-1303459042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:15:51Z,user_data=None,user_id='f1387c0adbe74072b52886ddc2af4182',uuid=8b5d7047-087e-44f4-b977-12c719f5a302,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "address": "fa:16:3e:72:48:35", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9a4ea0-41", "ovs_interfaceid": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Converting VIF {"id": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "address": "fa:16:3e:72:48:35", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9a4ea0-41", "ovs_interfaceid": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:35,bridge_name='br-int',has_traffic_filtering=True,id=bc9a4ea0-414f-43d8-995a-edb489f1b810,network=Network(ac0fadd7-d406-42a9-84c3-72fcfa33dc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9a4ea0-41') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG os_vif [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:35,bridge_name='br-int',has_traffic_filtering=True,id=bc9a4ea0-414f-43d8-995a-edb489f1b810,network=Network(ac0fadd7-d406-42a9-84c3-72fcfa33dc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9a4ea0-41') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc9a4ea0-41, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc9a4ea0-41, col_values=(('external_ids', {'iface-id': 'bc9a4ea0-414f-43d8-995a-edb489f1b810', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:48:35', 'vm-uuid': '8b5d7047-087e-44f4-b977-12c719f5a302'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:52 user nova-compute[72019]: INFO os_vif [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:35,bridge_name='br-int',has_traffic_filtering=True,id=bc9a4ea0-414f-43d8-995a-edb489f1b810,network=Network(ac0fadd7-d406-42a9-84c3-72fcfa33dc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9a4ea0-41')
Apr 14 13:15:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:15:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] No VIF found with MAC fa:16:3e:72:48:35, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:15:53 user nova-compute[72019]: DEBUG nova.network.neutron [req-f1033db3-7991-4c0c-b832-101d6414f877 req-1e49cc21-dccc-463e-90c1-dc3e7c701405 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Updated VIF entry in instance network info cache for port bc9a4ea0-414f-43d8-995a-edb489f1b810. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:15:53 user nova-compute[72019]: DEBUG nova.network.neutron [req-f1033db3-7991-4c0c-b832-101d6414f877 req-1e49cc21-dccc-463e-90c1-dc3e7c701405 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Updating instance_info_cache with network_info: [{"id": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "address": "fa:16:3e:72:48:35", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9a4ea0-41", "ovs_interfaceid": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f1033db3-7991-4c0c-b832-101d6414f877 req-1e49cc21-dccc-463e-90c1-dc3e7c701405 service nova] Releasing lock "refresh_cache-8b5d7047-087e-44f4-b977-12c719f5a302" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:15:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:53 user nova-compute[72019]: INFO nova.compute.manager [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Detaching volume ecf06e30-17dc-45c5-9fb1-5db1599ef12d
Apr 14 13:15:53 user nova-compute[72019]: INFO nova.virt.block_device [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Attempting to driver detach volume ecf06e30-17dc-45c5-9fb1-5db1599ef12d from mountpoint /dev/vdb
Apr 14 13:15:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Attempting to detach device vdb from instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:15:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:15:54 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:15:54 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:15:54 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:15:54 user nova-compute[72019]:   <serial>ecf06e30-17dc-45c5-9fb1-5db1599ef12d</serial>
Apr 14 13:15:54 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:15:54 user nova-compute[72019]: </disk>
Apr 14 13:15:54 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:15:54 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Successfully detached device vdb from instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 from the persistent domain config.
Apr 14 13:15:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:15:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:15:54 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:15:54 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:15:54 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:15:54 user nova-compute[72019]:   <serial>ecf06e30-17dc-45c5-9fb1-5db1599ef12d</serial>
Apr 14 13:15:54 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:15:54 user nova-compute[72019]: </disk>
Apr 14 13:15:54 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:15:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-e8ef7683-c095-46ff-9cac-e15956e3e8cb req-204a84a9-dc52-437c-8b39-56df41b71274 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received event network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e8ef7683-c095-46ff-9cac-e15956e3e8cb req-204a84a9-dc52-437c-8b39-56df41b71274 service nova] Acquiring lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e8ef7683-c095-46ff-9cac-e15956e3e8cb req-204a84a9-dc52-437c-8b39-56df41b71274 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e8ef7683-c095-46ff-9cac-e15956e3e8cb req-204a84a9-dc52-437c-8b39-56df41b71274 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-e8ef7683-c095-46ff-9cac-e15956e3e8cb req-204a84a9-dc52-437c-8b39-56df41b71274 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] No waiting events found dispatching network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:54 user nova-compute[72019]: WARNING nova.compute.manager [req-e8ef7683-c095-46ff-9cac-e15956e3e8cb req-204a84a9-dc52-437c-8b39-56df41b71274 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received unexpected event network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance with vm_state building and task_state spawning.
Apr 14 13:15:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478155.0444543, 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:15:55 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Successfully detached device vdb from instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 from the live domain config.
Apr 14 13:15:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqnlNyVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:55 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[275a0bfb-becd-4b70-b064-033b278d3724]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:15:55 user nova-compute[72019]: No targets found.
Apr 14 13:15:55 user nova-compute[72019]: iSNS:
Apr 14 13:15:55 user nova-compute[72019]: No targets found.
Apr 14 13:15:55 user nova-compute[72019]: STATIC:
Apr 14 13:15:55 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d
Apr 14 13:15:55 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:55 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:55 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:15:55 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:55 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:55 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:15:55 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:55 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:55 user nova-compute[72019]: FIRMWARE:
Apr 14 13:15:55 user nova-compute[72019]: No targets found.
Apr 14 13:15:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:15:55 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:15:55 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[949049e1-3846-45d5-adcc-57d3e1f38ef5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a17839-7e86-49d8-9b74-8d3342f3519e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:55 user nova-compute[72019]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d (non-flash)
Apr 14 13:15:55 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:55 user nova-compute[72019]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d (non-flash)
Apr 14 13:15:55 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74900f23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d'): ({'sdb'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Removing single pathed devices sdb {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bf1dfc-7870-473b-a769-f11e9198e614]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac05ba3-57f1-4d87-9fc1-ac7fe661de22]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Flushing IO for device /dev/sdb {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.046s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce777ccc-e11d-40f9-974a-aabe6ede38c0]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a53985-de16-4a8e-8099-d72b9cb3eb00]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[989e8fc1-0dfc-44ab-aff0-22bf3e58a9f3]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f957075f-2380-4d52-8e15-3d409bf83970]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d, portal: 172.16.0.220,3260]
Apr 14 13:15:55 user nova-compute[72019]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d, portal: 172.16.0.220,3260] successful.
Apr 14 13:15:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b1f74c-3881-4600-9650-823fe9dbb15a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] <== disconnect_volume: return (396ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG nova.objects.instance [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lazy-loading 'flavor' on Instance uuid 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.492s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.373s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:56 user nova-compute[72019]: INFO nova.compute.manager [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Terminating instance
Apr 14 13:15:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-50d95919-1613-4b22-b80b-f1a6bb8e0ccc req-79699e16-0c2d-4444-9fda-78e14cef669a service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Received event network-vif-unplugged-dde4f0a3-4573-4f17-aa86-fef9fd14059e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-50d95919-1613-4b22-b80b-f1a6bb8e0ccc req-79699e16-0c2d-4444-9fda-78e14cef669a service nova] Acquiring lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-50d95919-1613-4b22-b80b-f1a6bb8e0ccc req-79699e16-0c2d-4444-9fda-78e14cef669a service nova] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-50d95919-1613-4b22-b80b-f1a6bb8e0ccc req-79699e16-0c2d-4444-9fda-78e14cef669a service nova] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-50d95919-1613-4b22-b80b-f1a6bb8e0ccc req-79699e16-0c2d-4444-9fda-78e14cef669a service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] No waiting events found dispatching network-vif-unplugged-dde4f0a3-4573-4f17-aa86-fef9fd14059e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-50d95919-1613-4b22-b80b-f1a6bb8e0ccc req-79699e16-0c2d-4444-9fda-78e14cef669a service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Received event network-vif-unplugged-dde4f0a3-4573-4f17-aa86-fef9fd14059e for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-9fe3a100-dad8-4cdd-8968-25aef5d403af req-78d7a82d-6c23-4522-9ef3-fb3ac99d21e9 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received event network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9fe3a100-dad8-4cdd-8968-25aef5d403af req-78d7a82d-6c23-4522-9ef3-fb3ac99d21e9 service nova] Acquiring lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9fe3a100-dad8-4cdd-8968-25aef5d403af req-78d7a82d-6c23-4522-9ef3-fb3ac99d21e9 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9fe3a100-dad8-4cdd-8968-25aef5d403af req-78d7a82d-6c23-4522-9ef3-fb3ac99d21e9 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-9fe3a100-dad8-4cdd-8968-25aef5d403af req-78d7a82d-6c23-4522-9ef3-fb3ac99d21e9 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] No waiting events found dispatching network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:56 user nova-compute[72019]: WARNING nova.compute.manager [req-9fe3a100-dad8-4cdd-8968-25aef5d403af req-78d7a82d-6c23-4522-9ef3-fb3ac99d21e9 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received unexpected event network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance with vm_state building and task_state spawning.
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478157.068633, 8b5d7047-087e-44f4-b977-12c719f5a302 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:15:57 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] VM Resumed (Lifecycle Event)
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:15:57 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Instance spawned successfully.
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:15:57 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478157.0687885, 8b5d7047-087e-44f4-b977-12c719f5a302 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:15:57 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] VM Started (Lifecycle Event)
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:15:57 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Instance destroyed successfully.
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.objects.instance [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lazy-loading 'resources' on Instance uuid 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:15:57 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1440515588',display_name='tempest-VolumesSnapshotTestJSON-instance-1440515588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1440515588',id=13,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fe64d1d65224162b60849eace352cb4',ramdisk_id='',reservation_id='r-3nnv165w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1137775211',owner_user_name='tempest-VolumesSnapshotTestJSON-1137775211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:41Z,user_data=None,user_id='0f3445d14b0a44fd999bc2fc875c77bb',uuid=387e72a2-6fd9-4cd7-ab72-67535fc67fd5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "address": "fa:16:3e:29:90:2f", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde4f0a3-45", "ovs_interfaceid": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Converting VIF {"id": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "address": "fa:16:3e:29:90:2f", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde4f0a3-45", "ovs_interfaceid": "dde4f0a3-4573-4f17-aa86-fef9fd14059e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=dde4f0a3-4573-4f17-aa86-fef9fd14059e,network=Network(548d2c7a-ae94-4d89-8980-cb14f224fca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde4f0a3-45') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG os_vif [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=dde4f0a3-4573-4f17-aa86-fef9fd14059e,network=Network(548d2c7a-ae94-4d89-8980-cb14f224fca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde4f0a3-45') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdde4f0a3-45, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:15:57 user nova-compute[72019]: INFO nova.compute.manager [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Took 5.97 seconds to spawn the instance on the hypervisor.
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:15:57 user nova-compute[72019]: INFO os_vif [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:90:2f,bridge_name='br-int',has_traffic_filtering=True,id=dde4f0a3-4573-4f17-aa86-fef9fd14059e,network=Network(548d2c7a-ae94-4d89-8980-cb14f224fca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde4f0a3-45')
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqnlNyVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:15:57 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:15:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb7100b-7f45-4df2-a1f4-f3379d79dbc5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:15:57 user nova-compute[72019]: No targets found.
Apr 14 13:15:57 user nova-compute[72019]: iSNS:
Apr 14 13:15:57 user nova-compute[72019]: No targets found.
Apr 14 13:15:57 user nova-compute[72019]: STATIC:
Apr 14 13:15:57 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:15:57 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:57 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:57 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:15:57 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:15:57 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:15:57 user nova-compute[72019]: FIRMWARE:
Apr 14 13:15:57 user nova-compute[72019]: No targets found.
Apr 14 13:15:57 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:15:57 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:15:57 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecf06e30-17dc-45c5-9fb1-5db1599ef12d', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae19ac6-ed82-4436-8ff8-b9287f8949fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dd077e-8f0f-4b6d-9987-c79f3fdfc78b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:57 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:57 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:15:57 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:15:57 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74900f2320>, {}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Disconnecting from: [] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] <== disconnect_volume: return (81ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:15:57 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Deleting instance files /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5_del
Apr 14 13:15:57 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Deletion of /opt/stack/data/nova/instances/387e72a2-6fd9-4cd7-ab72-67535fc67fd5_del complete
Apr 14 13:15:57 user nova-compute[72019]: INFO nova.compute.manager [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Took 7.13 seconds to build instance.
Apr 14 13:15:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "8b5d7047-087e-44f4-b977-12c719f5a302" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.235s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:57 user nova-compute[72019]: INFO nova.compute.manager [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 14 13:15:57 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:15:57 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:15:58 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:58 user nova-compute[72019]: DEBUG nova.compute.manager [req-821c7df9-529b-48e0-b0e9-3a34c46a14ba req-fafb0c6a-eabe-4595-9dc1-24bf7a8ac48e service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Received event network-vif-deleted-dde4f0a3-4573-4f17-aa86-fef9fd14059e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:58 user nova-compute[72019]: INFO nova.compute.manager [req-821c7df9-529b-48e0-b0e9-3a34c46a14ba req-fafb0c6a-eabe-4595-9dc1-24bf7a8ac48e service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Neutron deleted interface dde4f0a3-4573-4f17-aa86-fef9fd14059e; detaching it from the instance and deleting it from the info cache
Apr 14 13:15:58 user nova-compute[72019]: DEBUG nova.network.neutron [req-821c7df9-529b-48e0-b0e9-3a34c46a14ba req-fafb0c6a-eabe-4595-9dc1-24bf7a8ac48e service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:15:58 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Took 0.65 seconds to deallocate network for instance.
Apr 14 13:15:58 user nova-compute[72019]: DEBUG nova.compute.manager [req-821c7df9-529b-48e0-b0e9-3a34c46a14ba req-fafb0c6a-eabe-4595-9dc1-24bf7a8ac48e service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Detach interface failed, port_id=dde4f0a3-4573-4f17-aa86-fef9fd14059e, reason: Instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:15:58 user nova-compute[72019]: WARNING nova.volume.cinder [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Attachment a5720a17-9c54-4ac5-9758-88ed56ae757c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a5720a17-9c54-4ac5-9758-88ed56ae757c. (HTTP 404) (Request-ID: req-a35c7ad6-99ac-4b85-b128-7456844357d0)
Apr 14 13:15:58 user nova-compute[72019]: INFO nova.compute.manager [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Took 0.03 seconds to detach 1 volumes for instance.
Apr 14 13:15:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:58 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:15:58 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:15:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:58 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Deleted allocations for instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5
Apr 14 13:15:58 user nova-compute[72019]: DEBUG nova.compute.manager [req-647e0c90-ecaf-48d9-9b3a-3df9a679f13f req-838d399c-d3f3-48f6-be88-41f80e3aeecd service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Received event network-vif-plugged-dde4f0a3-4573-4f17-aa86-fef9fd14059e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:15:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-647e0c90-ecaf-48d9-9b3a-3df9a679f13f req-838d399c-d3f3-48f6-be88-41f80e3aeecd service nova] Acquiring lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:15:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-647e0c90-ecaf-48d9-9b3a-3df9a679f13f req-838d399c-d3f3-48f6-be88-41f80e3aeecd service nova] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:15:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-647e0c90-ecaf-48d9-9b3a-3df9a679f13f req-838d399c-d3f3-48f6-be88-41f80e3aeecd service nova] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:15:58 user nova-compute[72019]: DEBUG nova.compute.manager [req-647e0c90-ecaf-48d9-9b3a-3df9a679f13f req-838d399c-d3f3-48f6-be88-41f80e3aeecd service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] No waiting events found dispatching network-vif-plugged-dde4f0a3-4573-4f17-aa86-fef9fd14059e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:15:58 user nova-compute[72019]: WARNING nova.compute.manager [req-647e0c90-ecaf-48d9-9b3a-3df9a679f13f req-838d399c-d3f3-48f6-be88-41f80e3aeecd service nova] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Received unexpected event network-vif-plugged-dde4f0a3-4573-4f17-aa86-fef9fd14059e for instance with vm_state deleted and task_state None.
Apr 14 13:15:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "387e72a2-6fd9-4cd7-ab72-67535fc67fd5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.433s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:03 user nova-compute[72019]: INFO nova.compute.manager [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Terminating instance
Apr 14 13:16:03 user nova-compute[72019]: DEBUG nova.compute.manager [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:16:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG nova.compute.manager [req-a65b19bd-b941-4549-9c51-921754ab373a req-a7be2471-3842-4807-adef-72413e65495a service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received event network-vif-unplugged-0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a65b19bd-b941-4549-9c51-921754ab373a req-a7be2471-3842-4807-adef-72413e65495a service nova] Acquiring lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a65b19bd-b941-4549-9c51-921754ab373a req-a7be2471-3842-4807-adef-72413e65495a service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a65b19bd-b941-4549-9c51-921754ab373a req-a7be2471-3842-4807-adef-72413e65495a service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG nova.compute.manager [req-a65b19bd-b941-4549-9c51-921754ab373a req-a7be2471-3842-4807-adef-72413e65495a service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] No waiting events found dispatching network-vif-unplugged-0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG nova.compute.manager [req-a65b19bd-b941-4549-9c51-921754ab373a req-a7be2471-3842-4807-adef-72413e65495a service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received event network-vif-unplugged-0946e034-1e6c-42d6-a8e2-1b24fabc000c for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:04 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Instance destroyed successfully.
Apr 14 13:16:04 user nova-compute[72019]: DEBUG nova.objects.instance [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lazy-loading 'resources' on Instance uuid 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T13:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1305382448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1305382448',id=10,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4duIqCv7vEVSja8IqrS2m8nOyBfEtm9GNp6oVWYmKH8ODAqPLRXepqVchMI9s9qHWy17HwfyhVBB5y+o51mGHAALloM+mnGYFQ/OSrPtSKKkLrtAKZzJf5wagS5jGc7w==',key_name='tempest-keypair-1468650109',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab3a7e094618456381891d4532bb3cf2',ramdisk_id='',reservation_id='r-34cd3eyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-246329900',owner_user_name='tempest-TaggedAttachmentsTest-246329900-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016ee10024d2449c93d67e0b14f09f95',uuid=15df44a4-fc31-4dfa-870d-0dd1db47ccd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Converting VIF {"id": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "address": "fa:16:3e:e8:46:60", "network": {"id": "53eda3e7-82e5-4c42-81d1-a180eb205a2e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-545993697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab3a7e094618456381891d4532bb3cf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0946e034-1e", "ovs_interfaceid": "0946e034-1e6c-42d6-a8e2-1b24fabc000c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:46:60,bridge_name='br-int',has_traffic_filtering=True,id=0946e034-1e6c-42d6-a8e2-1b24fabc000c,network=Network(53eda3e7-82e5-4c42-81d1-a180eb205a2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0946e034-1e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG os_vif [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:46:60,bridge_name='br-int',has_traffic_filtering=True,id=0946e034-1e6c-42d6-a8e2-1b24fabc000c,network=Network(53eda3e7-82e5-4c42-81d1-a180eb205a2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0946e034-1e') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0946e034-1e, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:04 user nova-compute[72019]: INFO os_vif [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:46:60,bridge_name='br-int',has_traffic_filtering=True,id=0946e034-1e6c-42d6-a8e2-1b24fabc000c,network=Network(53eda3e7-82e5-4c42-81d1-a180eb205a2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0946e034-1e')
Apr 14 13:16:04 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Deleting instance files /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7_del
Apr 14 13:16:04 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Deletion of /opt/stack/data/nova/instances/15df44a4-fc31-4dfa-870d-0dd1db47ccd7_del complete
Apr 14 13:16:04 user nova-compute[72019]: INFO nova.compute.manager [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 13:16:04 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:16:04 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:16:06 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:16:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-2ed17aa7-fed9-4ec2-a6d5-c4449a1004b8 req-f00e35a4-e741-40df-8a40-904594713a1b service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received event network-vif-deleted-0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:06 user nova-compute[72019]: INFO nova.compute.manager [req-2ed17aa7-fed9-4ec2-a6d5-c4449a1004b8 req-f00e35a4-e741-40df-8a40-904594713a1b service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Neutron deleted interface 0946e034-1e6c-42d6-a8e2-1b24fabc000c; detaching it from the instance and deleting it from the info cache
Apr 14 13:16:06 user nova-compute[72019]: DEBUG nova.network.neutron [req-2ed17aa7-fed9-4ec2-a6d5-c4449a1004b8 req-f00e35a4-e741-40df-8a40-904594713a1b service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:16:06 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Took 1.51 seconds to deallocate network for instance.
Apr 14 13:16:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-2ed17aa7-fed9-4ec2-a6d5-c4449a1004b8 req-f00e35a4-e741-40df-8a40-904594713a1b service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Detach interface failed, port_id=0946e034-1e6c-42d6-a8e2-1b24fabc000c, reason: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:16:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-0b9a077d-f2ab-466f-904a-cef45525fd9a req-4f3241e5-bfc9-4662-81d1-339ecac4b3b5 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received event network-vif-plugged-0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0b9a077d-f2ab-466f-904a-cef45525fd9a req-4f3241e5-bfc9-4662-81d1-339ecac4b3b5 service nova] Acquiring lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0b9a077d-f2ab-466f-904a-cef45525fd9a req-4f3241e5-bfc9-4662-81d1-339ecac4b3b5 service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0b9a077d-f2ab-466f-904a-cef45525fd9a req-4f3241e5-bfc9-4662-81d1-339ecac4b3b5 service nova] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-0b9a077d-f2ab-466f-904a-cef45525fd9a req-4f3241e5-bfc9-4662-81d1-339ecac4b3b5 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] No waiting events found dispatching network-vif-plugged-0946e034-1e6c-42d6-a8e2-1b24fabc000c {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:16:06 user nova-compute[72019]: WARNING nova.compute.manager [req-0b9a077d-f2ab-466f-904a-cef45525fd9a req-4f3241e5-bfc9-4662-81d1-339ecac4b3b5 service nova] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Received unexpected event network-vif-plugged-0946e034-1e6c-42d6-a8e2-1b24fabc000c for instance with vm_state deleted and task_state None.
Apr 14 13:16:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:06 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:16:06 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:16:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.567s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:06 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Deleted allocations for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7
Apr 14 13:16:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "15df44a4-fc31-4dfa-870d-0dd1db47ccd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.169s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:12 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478157.1954243, 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:16:12 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] VM Stopped (Lifecycle Event)
Apr 14 13:16:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-61fddcb7-9d00-457b-aaba-118cf69e45ba None None] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:16:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "990b083b-744a-42cb-88f3-7ae16a5abed4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:18 user nova-compute[72019]: INFO nova.compute.manager [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Terminating instance
Apr 14 13:16:18 user nova-compute[72019]: DEBUG nova.compute.manager [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:16:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-e580b2de-f637-48c2-adb6-f81111065f72 req-0de3356a-f321-4c8a-b3ca-f1202048f2a3 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Received event network-vif-unplugged-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e580b2de-f637-48c2-adb6-f81111065f72 req-0de3356a-f321-4c8a-b3ca-f1202048f2a3 service nova] Acquiring lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e580b2de-f637-48c2-adb6-f81111065f72 req-0de3356a-f321-4c8a-b3ca-f1202048f2a3 service nova] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e580b2de-f637-48c2-adb6-f81111065f72 req-0de3356a-f321-4c8a-b3ca-f1202048f2a3 service nova] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-e580b2de-f637-48c2-adb6-f81111065f72 req-0de3356a-f321-4c8a-b3ca-f1202048f2a3 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] No waiting events found dispatching network-vif-unplugged-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-e580b2de-f637-48c2-adb6-f81111065f72 req-0de3356a-f321-4c8a-b3ca-f1202048f2a3 service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Received event network-vif-unplugged-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:16:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Instance destroyed successfully.
Apr 14 13:16:19 user nova-compute[72019]: DEBUG nova.objects.instance [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lazy-loading 'resources' on Instance uuid 990b083b-744a-42cb-88f3-7ae16a5abed4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2039788772',display_name='tempest-TestVolumeSwap-server-2039788772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2039788772',id=9,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQGkfzhrgRQt3R+2yTZx1eIPdWpktZ8TGxkXnf/ktvKVPNojK9B8SUmMt34Q3Xrk7GLPxqU8Sg3MgwUeKs/D2/0ZoXxgbSLa7+dKYceaNQ0dza/dcfmvf3TnWbFUP+mKQ==',key_name='tempest-keypair-157168234',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18dfe057a9f742ceb908883f28463a43',ramdisk_id='',reservation_id='r-bq64jr81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1055532166',owner_user_name='tempest-TestVolumeSwap-1055532166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e33a6a8f8f441978437332de5499609',uuid=990b083b-744a-42cb-88f3-7ae16a5abed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "address": "fa:16:3e:d5:ed:2c", "network": {"id": "a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972", "bridge": "br-int", "label": "tempest-TestVolumeSwap-715659165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dfe057a9f742ceb908883f28463a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932d0b4b-da", "ovs_interfaceid": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Converting VIF {"id": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "address": "fa:16:3e:d5:ed:2c", "network": {"id": "a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972", "bridge": "br-int", "label": "tempest-TestVolumeSwap-715659165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18dfe057a9f742ceb908883f28463a43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932d0b4b-da", "ovs_interfaceid": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:ed:2c,bridge_name='br-int',has_traffic_filtering=True,id=932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3,network=Network(a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932d0b4b-da') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG os_vif [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:ed:2c,bridge_name='br-int',has_traffic_filtering=True,id=932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3,network=Network(a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932d0b4b-da') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap932d0b4b-da, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478164.4694297, 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:16:19 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] VM Stopped (Lifecycle Event)
Apr 14 13:16:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:19 user nova-compute[72019]: INFO os_vif [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:ed:2c,bridge_name='br-int',has_traffic_filtering=True,id=932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3,network=Network(a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932d0b4b-da')
Apr 14 13:16:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Deleting instance files /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4_del
Apr 14 13:16:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Deletion of /opt/stack/data/nova/instances/990b083b-744a-42cb-88f3-7ae16a5abed4_del complete
Apr 14 13:16:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-379c579d-e18d-4e6d-bb42-50f2f58a13c0 None None] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:16:19 user nova-compute[72019]: INFO nova.compute.manager [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 14 13:16:19 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:16:19 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:16:20 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:16:20 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:16:20 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:16:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:16:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:16:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:16:20 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:16:20 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:16:20 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Took 0.98 seconds to deallocate network for instance.
Apr 14 13:16:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:20 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:16:20 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:16:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Updating instance_info_cache with network_info: [{"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:16:21 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Deleted allocations for instance 990b083b-744a-42cb-88f3-7ae16a5abed4
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-008bdb08-1116-4d71-bb80-f5173c2a836a req-4a32ecc3-35e6-4e46-81aa-9654e1f0daad service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Received event network-vif-plugged-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-008bdb08-1116-4d71-bb80-f5173c2a836a req-4a32ecc3-35e6-4e46-81aa-9654e1f0daad service nova] Acquiring lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-008bdb08-1116-4d71-bb80-f5173c2a836a req-4a32ecc3-35e6-4e46-81aa-9654e1f0daad service nova] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-008bdb08-1116-4d71-bb80-f5173c2a836a req-4a32ecc3-35e6-4e46-81aa-9654e1f0daad service nova] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-008bdb08-1116-4d71-bb80-f5173c2a836a req-4a32ecc3-35e6-4e46-81aa-9654e1f0daad service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] No waiting events found dispatching network-vif-plugged-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:16:21 user nova-compute[72019]: WARNING nova.compute.manager [req-008bdb08-1116-4d71-bb80-f5173c2a836a req-4a32ecc3-35e6-4e46-81aa-9654e1f0daad service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Received unexpected event network-vif-plugged-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 for instance with vm_state deleted and task_state None.
Apr 14 13:16:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-008bdb08-1116-4d71-bb80-f5173c2a836a req-4a32ecc3-35e6-4e46-81aa-9654e1f0daad service nova] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Received event network-vif-deleted-932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "990b083b-744a-42cb-88f3-7ae16a5abed4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.464s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'flavor' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquired lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG nova.network.neutron [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'info_cache' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG nova.network.neutron [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Updating instance_info_cache with network_info: [{"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Releasing lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:16:21 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Instance destroyed successfully.
Apr 14 13:16:21 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'resources' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-303889780',display_name='tempest-AttachVolumeTestJSON-server-303889780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-303889780',id=2,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/dvc2S0OuXcn9jdXIUza2Um4pu7uvo7HYOG07F6fnb37QHZ7NdhG6QTqMXI3jbPISSO6VjhwOBRe6Loz+h6IedCzg/r0/inTPnR9XWKC/g2HpuZ9SyjRQ2J4QlDLD1WA==',key_name='tempest-keypair-641815070',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:12:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a82aa8e6724a41e1a4e4d7783876536e',ramdisk_id='',reservation_id='r-s06nam6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-581564101',owner_user_name='tempest-AttachVolumeTestJSON-581564101-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:14:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e4e432ab0d448db8c2437e40cbe0cd',uuid=84bf295a-37fa-4463-bddb-38ac2c5d2cf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converting VIF {"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_vif [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4b573e5-ec, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:16:22 user nova-compute[72019]: INFO os_vif [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec')
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WydfNSbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:16:22 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7380ea3a-47b7-45ae-b06a-b78c4afe4392]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:16:22 user nova-compute[72019]: No targets found.
Apr 14 13:16:22 user nova-compute[72019]: iSNS:
Apr 14 13:16:22 user nova-compute[72019]: No targets found.
Apr 14 13:16:22 user nova-compute[72019]: STATIC:
Apr 14 13:16:22 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:16:22 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:16:22 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:16:22 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:16:22 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:16:22 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:16:22 user nova-compute[72019]: FIRMWARE:
Apr 14 13:16:22 user nova-compute[72019]: No targets found.
Apr 14 13:16:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:16:22 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:16:22 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[387efc18-35d9-48fe-b829-5f65a67ee9bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[172a76e2-2803-425a-ad0f-ec0d17f3b012]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:16:22 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:16:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:16:22 user nova-compute[72019]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:16:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74905b41f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999'): ({'sdi'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Removing single pathed devices sdi {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[964bdad3-7ada-4656-a5cc-d8ec87046236]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8942cd5c-25bd-47fc-9fa2-c95e2db2fbf1]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flushing IO for device /dev/sdi {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d81617c-a50a-4f6e-81c8-b88c8564cb62]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb627f8-ceed-4510-b88b-5224d55a6b39]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] SCSI volumes sdi have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83600b4-5f1d-40b6-9043-6e6b4f917bf8]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78bf85a-bf70-481a-9462-a3a7eb7baff3]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260]
Apr 14 13:16:22 user nova-compute[72019]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260] successful.
Apr 14 13:16:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e93c5e8-a9d9-4392-b7ce-bb53e61b55a8]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] <== disconnect_volume: return (349ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Start _get_guest_xml network_info=[{"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '0265212b-c673-4d9b-b759-f01b26ea7c0e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WydfNSbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '84bf295a-37fa-4463-bddb-38ac2c5d2cf7', 'attached_at': '', 'detached_at': '', 'volume_id': '7f6a3c6d-43d9-4137-b0e1-699b36e9b999', 'serial': '7f6a3c6d-43d9-4137-b0e1-699b36e9b999'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'numa_topology' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:16:22 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'vcpu_model' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WydfNSbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:16:22 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:16:22 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:16:22 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa48136c-2cc3-487a-912f-40138afdbd0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:16:22 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[858ef668-34a5-43d9-abb4-54b9103890dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999] added
Apr 14 13:16:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c56559e-e7d0-446f-a7a7-4a1865a28824]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e1d63d-a576-412e-b9b7-8b29bafafb78]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WydfNSbX {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WydfNSbX" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a27de8-5ce2-44c4-83e0-e962102741c2]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WydfNSbX'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53edd79-93d8-48e0-87aa-20a9ddbb122b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4370c959-b6a7-49a4-be70-e4a83e795f01]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:16:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:16:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fca875-70ea-4f8e-b0d2-9ab405d8cee6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260]
Apr 14 13:16:22 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260] successful.
Apr 14 13:16:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5966b6c-abab-4ffb-8fe3-d225e5b186ac]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dca5e6-3cde-4e08-861b-cfaa1fcb8bb0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:16:22 user nova-compute[72019]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:16:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:16:22 user nova-compute[72019]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:16:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc54339-df8c-4ec1-8211-3422e5bdcf9d]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:16:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WydfNSbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23730383937383031', 'path': '/dev/sdb'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:16:23 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730383937383031', 'path': '/dev/sdb'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-303889780',display_name='tempest-AttachVolumeTestJSON-server-303889780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-303889780',id=2,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/dvc2S0OuXcn9jdXIUza2Um4pu7uvo7HYOG07F6fnb37QHZ7NdhG6QTqMXI3jbPISSO6VjhwOBRe6Loz+h6IedCzg/r0/inTPnR9XWKC/g2HpuZ9SyjRQ2J4QlDLD1WA==',key_name='tempest-keypair-641815070',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:12:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a82aa8e6724a41e1a4e4d7783876536e',ramdisk_id='',reservation_id='r-s06nam6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-581564101',owner_user_name='tempest-AttachVolumeTestJSON-581564101-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:14:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e4e432ab0d448db8c2437e40cbe0cd',uuid=84bf295a-37fa-4463-bddb-38ac2c5d2cf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converting VIF {"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'pci_devices' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:16:24 user nova-compute[72019]:   <uuid>84bf295a-37fa-4463-bddb-38ac2c5d2cf7</uuid>
Apr 14 13:16:24 user nova-compute[72019]:   <name>instance-00000002</name>
Apr 14 13:16:24 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:16:24 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:16:24 user nova-compute[72019]:   <metadata>
Apr 14 13:16:24 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:16:24 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:16:24 user nova-compute[72019]:       <nova:name>tempest-AttachVolumeTestJSON-server-303889780</nova:name>
Apr 14 13:16:24 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:16:22</nova:creationTime>
Apr 14 13:16:24 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:16:24 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:16:24 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:16:24 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:16:24 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:16:24 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:16:24 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:16:24 user nova-compute[72019]:       <nova:owner>
Apr 14 13:16:24 user nova-compute[72019]:         <nova:user uuid="d7e4e432ab0d448db8c2437e40cbe0cd">tempest-AttachVolumeTestJSON-581564101-project-member</nova:user>
Apr 14 13:16:24 user nova-compute[72019]:         <nova:project uuid="a82aa8e6724a41e1a4e4d7783876536e">tempest-AttachVolumeTestJSON-581564101</nova:project>
Apr 14 13:16:24 user nova-compute[72019]:       </nova:owner>
Apr 14 13:16:24 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:16:24 user nova-compute[72019]:       <nova:ports>
Apr 14 13:16:24 user nova-compute[72019]:         <nova:port uuid="e4b573e5-ec9a-4d14-974b-d8f2bf49c980">
Apr 14 13:16:24 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 13:16:24 user nova-compute[72019]:         </nova:port>
Apr 14 13:16:24 user nova-compute[72019]:       </nova:ports>
Apr 14 13:16:24 user nova-compute[72019]:     </nova:instance>
Apr 14 13:16:24 user nova-compute[72019]:   </metadata>
Apr 14 13:16:24 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:16:24 user nova-compute[72019]:     <system>
Apr 14 13:16:24 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:16:24 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:16:24 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:16:24 user nova-compute[72019]:       <entry name="serial">84bf295a-37fa-4463-bddb-38ac2c5d2cf7</entry>
Apr 14 13:16:24 user nova-compute[72019]:       <entry name="uuid">84bf295a-37fa-4463-bddb-38ac2c5d2cf7</entry>
Apr 14 13:16:24 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:16:24 user nova-compute[72019]:     </system>
Apr 14 13:16:24 user nova-compute[72019]:   </sysinfo>
Apr 14 13:16:24 user nova-compute[72019]:   <os>
Apr 14 13:16:24 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:16:24 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:16:24 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:16:24 user nova-compute[72019]:   </os>
Apr 14 13:16:24 user nova-compute[72019]:   <features>
Apr 14 13:16:24 user nova-compute[72019]:     <acpi/>
Apr 14 13:16:24 user nova-compute[72019]:     <apic/>
Apr 14 13:16:24 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:16:24 user nova-compute[72019]:   </features>
Apr 14 13:16:24 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:16:24 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:16:24 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:16:24 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:16:24 user nova-compute[72019]:   </clock>
Apr 14 13:16:24 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:16:24 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:16:24 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:16:24 user nova-compute[72019]:   </cpu>
Apr 14 13:16:24 user nova-compute[72019]:   <devices>
Apr 14 13:16:24 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:16:24 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:16:24 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk"/>
Apr 14 13:16:24 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:16:24 user nova-compute[72019]:     </disk>
Apr 14 13:16:24 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:16:24 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:16:24 user nova-compute[72019]:       <source dev="/dev/sdb"/>
Apr 14 13:16:24 user nova-compute[72019]:       <target dev="vdb" bus="virtio"/>
Apr 14 13:16:24 user nova-compute[72019]:       <serial>7f6a3c6d-43d9-4137-b0e1-699b36e9b999</serial>
Apr 14 13:16:24 user nova-compute[72019]:     </disk>
Apr 14 13:16:24 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:16:24 user nova-compute[72019]:       <mac address="fa:16:3e:23:7a:d0"/>
Apr 14 13:16:24 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:16:24 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:16:24 user nova-compute[72019]:       <target dev="tape4b573e5-ec"/>
Apr 14 13:16:24 user nova-compute[72019]:     </interface>
Apr 14 13:16:24 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:16:24 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/console.log" append="off"/>
Apr 14 13:16:24 user nova-compute[72019]:     </serial>
Apr 14 13:16:24 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:16:24 user nova-compute[72019]:     <video>
Apr 14 13:16:24 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:16:24 user nova-compute[72019]:     </video>
Apr 14 13:16:24 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:16:24 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:16:24 user nova-compute[72019]:     </rng>
Apr 14 13:16:24 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:16:24 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:16:24 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:16:24 user nova-compute[72019]:     </memballoon>
Apr 14 13:16:24 user nova-compute[72019]:   </devices>
Apr 14 13:16:24 user nova-compute[72019]: </domain>
Apr 14 13:16:24 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'trusted_certs' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Cannot resize image /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'migration_context' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-303889780',display_name='tempest-AttachVolumeTestJSON-server-303889780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-303889780',id=2,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/dvc2S0OuXcn9jdXIUza2Um4pu7uvo7HYOG07F6fnb37QHZ7NdhG6QTqMXI3jbPISSO6VjhwOBRe6Loz+h6IedCzg/r0/inTPnR9XWKC/g2HpuZ9SyjRQ2J4QlDLD1WA==',key_name='tempest-keypair-641815070',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:12:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a82aa8e6724a41e1a4e4d7783876536e',ramdisk_id='',reservation_id='r-s06nam6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-581564101',owner_user_name='tempest-AttachVolumeTestJSON-581564101-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:14:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e4e432ab0d448db8c2437e40cbe0cd',uuid=84bf295a-37fa-4463-bddb-38ac2c5d2cf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converting VIF {"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG os_vif [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4b573e5-ec, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4b573e5-ec, col_values=(('external_ids', {'iface-id': 'e4b573e5-ec9a-4d14-974b-d8f2bf49c980', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:7a:d0', 'vm-uuid': '84bf295a-37fa-4463-bddb-38ac2c5d2cf7'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:24 user nova-compute[72019]: INFO os_vif [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec')
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478188.5294075, 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:16:28 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] VM Resumed (Lifecycle Event)
Apr 14 13:16:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-153fcff7-7399-4130-a456-145939af477f req-3951e2e5-c5b5-47a7-a4a9-9b1e37007610 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-153fcff7-7399-4130-a456-145939af477f req-3951e2e5-c5b5-47a7-a4a9-9b1e37007610 service nova] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-153fcff7-7399-4130-a456-145939af477f req-3951e2e5-c5b5-47a7-a4a9-9b1e37007610 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-153fcff7-7399-4130-a456-145939af477f req-3951e2e5-c5b5-47a7-a4a9-9b1e37007610 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-153fcff7-7399-4130-a456-145939af477f req-3951e2e5-c5b5-47a7-a4a9-9b1e37007610 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] No waiting events found dispatching network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:16:28 user nova-compute[72019]: WARNING nova.compute.manager [req-153fcff7-7399-4130-a456-145939af477f req-3951e2e5-c5b5-47a7-a4a9-9b1e37007610 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received unexpected event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance with vm_state stopped and task_state powering-on.
Apr 14 13:16:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-702157df-a5e4-480f-ae81-5688b15ccbcf req-0ce6f893-4740-451d-8189-c7301e9efa52 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-702157df-a5e4-480f-ae81-5688b15ccbcf req-0ce6f893-4740-451d-8189-c7301e9efa52 service nova] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-702157df-a5e4-480f-ae81-5688b15ccbcf req-0ce6f893-4740-451d-8189-c7301e9efa52 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-702157df-a5e4-480f-ae81-5688b15ccbcf req-0ce6f893-4740-451d-8189-c7301e9efa52 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-702157df-a5e4-480f-ae81-5688b15ccbcf req-0ce6f893-4740-451d-8189-c7301e9efa52 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] No waiting events found dispatching network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:16:28 user nova-compute[72019]: WARNING nova.compute.manager [req-702157df-a5e4-480f-ae81-5688b15ccbcf req-0ce6f893-4740-451d-8189-c7301e9efa52 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received unexpected event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance with vm_state stopped and task_state powering-on.
Apr 14 13:16:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:16:28 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Instance rebooted successfully.
Apr 14 13:16:28 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:16:28 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:16:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7655MB free_disk=26.47759246826172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:16:28 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 13:16:28 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478188.5302525, 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:16:28 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] VM Started (Lifecycle Event)
Apr 14 13:16:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:16:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance c74c3463-6701-4150-9096-1775785e8e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance bb40ccf2-2c37-46ff-be3d-242dc69d0655 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 8b5d7047-087e-44f4-b977-12c719f5a302 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:34 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478179.4427383, 990b083b-744a-42cb-88f3-7ae16a5abed4 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:16:34 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] VM Stopped (Lifecycle Event)
Apr 14 13:16:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4f952314-b6fa-4578-998b-803c11439de6 None None] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:16:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:37 user nova-compute[72019]: DEBUG nova.compute.manager [req-f0cc1296-a090-4381-a9dd-b560bca8f23a req-256aa2da-555f-4601-bf8f-f0d53ddab140 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Received event network-changed-c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:37 user nova-compute[72019]: DEBUG nova.compute.manager [req-f0cc1296-a090-4381-a9dd-b560bca8f23a req-256aa2da-555f-4601-bf8f-f0d53ddab140 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Refreshing instance network info cache due to event network-changed-c1984923-9c3a-400f-9e54-c4bc6b476074. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:16:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f0cc1296-a090-4381-a9dd-b560bca8f23a req-256aa2da-555f-4601-bf8f-f0d53ddab140 service nova] Acquiring lock "refresh_cache-24179ea7-82e2-48fd-9aab-2e3bf7edb372" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:16:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f0cc1296-a090-4381-a9dd-b560bca8f23a req-256aa2da-555f-4601-bf8f-f0d53ddab140 service nova] Acquired lock "refresh_cache-24179ea7-82e2-48fd-9aab-2e3bf7edb372" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:16:37 user nova-compute[72019]: DEBUG nova.network.neutron [req-f0cc1296-a090-4381-a9dd-b560bca8f23a req-256aa2da-555f-4601-bf8f-f0d53ddab140 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Refreshing network info cache for port c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:16:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:37 user nova-compute[72019]: INFO nova.compute.manager [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Terminating instance
Apr 14 13:16:37 user nova-compute[72019]: DEBUG nova.compute.manager [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:16:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:38 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Instance destroyed successfully.
Apr 14 13:16:38 user nova-compute[72019]: DEBUG nova.objects.instance [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'resources' on Instance uuid 24179ea7-82e2-48fd-9aab-2e3bf7edb372 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-635632514',display_name='tempest-AttachVolumeNegativeTest-server-635632514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-635632514',id=14,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/584IerZHYCW7Vrg1ZzlqOqLu8QT1OK09DsRuAHJ64sJni4ga/8sJVg77u23BliovVhhCBDFa6Zfrn5rTMjHEinlCzk/yYvmpWxEgtFvbxo0L3max/KhBCJVMGH9tZ2g==',key_name='tempest-keypair-713053172',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:14:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6833a69217034c4d85ff10bf8aa2fa5c',ramdisk_id='',reservation_id='r-6wi0dhpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-893959880',owner_user_name='tempest-AttachVolumeNegativeTest-893959880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65812c6559684eddbdde33cd64ca1fba',uuid=24179ea7-82e2-48fd-9aab-2e3bf7edb372,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1984923-9c3a-400f-9e54-c4bc6b476074", "address": "fa:16:3e:26:5c:9a", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1984923-9c", "ovs_interfaceid": "c1984923-9c3a-400f-9e54-c4bc6b476074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:16:38 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converting VIF {"id": "c1984923-9c3a-400f-9e54-c4bc6b476074", "address": "fa:16:3e:26:5c:9a", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1984923-9c", "ovs_interfaceid": "c1984923-9c3a-400f-9e54-c4bc6b476074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:16:38 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:5c:9a,bridge_name='br-int',has_traffic_filtering=True,id=c1984923-9c3a-400f-9e54-c4bc6b476074,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1984923-9c') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:16:38 user nova-compute[72019]: DEBUG os_vif [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:5c:9a,bridge_name='br-int',has_traffic_filtering=True,id=c1984923-9c3a-400f-9e54-c4bc6b476074,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1984923-9c') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:16:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1984923-9c, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:16:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:16:38 user nova-compute[72019]: INFO os_vif [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:5c:9a,bridge_name='br-int',has_traffic_filtering=True,id=c1984923-9c3a-400f-9e54-c4bc6b476074,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1984923-9c')
Apr 14 13:16:38 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Deleting instance files /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372_del
Apr 14 13:16:38 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Deletion of /opt/stack/data/nova/instances/24179ea7-82e2-48fd-9aab-2e3bf7edb372_del complete
Apr 14 13:16:38 user nova-compute[72019]: INFO nova.compute.manager [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 14 13:16:38 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:16:38 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:16:38 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:16:38 user nova-compute[72019]: DEBUG nova.network.neutron [req-f0cc1296-a090-4381-a9dd-b560bca8f23a req-256aa2da-555f-4601-bf8f-f0d53ddab140 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Updated VIF entry in instance network info cache for port c1984923-9c3a-400f-9e54-c4bc6b476074. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:16:38 user nova-compute[72019]: DEBUG nova.network.neutron [req-f0cc1296-a090-4381-a9dd-b560bca8f23a req-256aa2da-555f-4601-bf8f-f0d53ddab140 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Updating instance_info_cache with network_info: [{"id": "c1984923-9c3a-400f-9e54-c4bc6b476074", "address": "fa:16:3e:26:5c:9a", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1984923-9c", "ovs_interfaceid": "c1984923-9c3a-400f-9e54-c4bc6b476074", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:16:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f0cc1296-a090-4381-a9dd-b560bca8f23a req-256aa2da-555f-4601-bf8f-f0d53ddab140 service nova] Releasing lock "refresh_cache-24179ea7-82e2-48fd-9aab-2e3bf7edb372" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:16:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Received event network-vif-unplugged-c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] Acquiring lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] Lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] Lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] No waiting events found dispatching network-vif-unplugged-c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:16:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Received event network-vif-unplugged-c1984923-9c3a-400f-9e54-c4bc6b476074 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:16:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Received event network-vif-plugged-c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] Acquiring lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] Lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] Lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] No waiting events found dispatching network-vif-plugged-c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:16:39 user nova-compute[72019]: WARNING nova.compute.manager [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Received unexpected event network-vif-plugged-c1984923-9c3a-400f-9e54-c4bc6b476074 for instance with vm_state active and task_state deleting.
Apr 14 13:16:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:40 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:16:40 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Took 1.58 seconds to deallocate network for instance.
Apr 14 13:16:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:40 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:16:40 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:16:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:40 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Deleted allocations for instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372
Apr 14 13:16:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "24179ea7-82e2-48fd-9aab-2e3bf7edb372" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.166s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-aafe5a37-d474-47dd-9c6c-f5c2610db1e7 req-5289c3e0-98ed-4968-a6e8-c03eb9ac1ed0 service nova] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Received event network-vif-deleted-c1984923-9c3a-400f-9e54-c4bc6b476074 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "847e2db8-10a7-416b-ae22-1c75b6d37817" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:16:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:16:42 user nova-compute[72019]: INFO nova.compute.claims [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Claim successful on node user
Apr 14 13:16:42 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:16:42 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:16:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:16:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:16:42 user nova-compute[72019]: DEBUG nova.network.neutron [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:16:42 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.policy [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f713f95191542f6a23ee25669061b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b4e44c0b8945079de567503aab3a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:16:43 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Creating image(s)
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "/opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "/opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "/opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "978f6fc8-1080-4840-ab8a-e025efe4f906" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:16:43 user nova-compute[72019]: INFO nova.compute.claims [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Claim successful on node user
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.148s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk 1073741824" returned: 0 in 0.054s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.network.neutron [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Successfully created port: af35aee5-c40d-47d2-82ea-3ff57c1d5495 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Cannot resize image /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.objects.instance [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lazy-loading 'migration_context' on Instance uuid 847e2db8-10a7-416b-ae22-1c75b6d37817 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Ensure instance console log exists: /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:16:43 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:16:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG nova.policy [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:16:44 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Creating image(s)
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "/opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "/opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "/opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk 1073741824" returned: 0 in 0.048s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Cannot resize image /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'migration_context' on Instance uuid 978f6fc8-1080-4840-ab8a-e025efe4f906 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Ensure instance console log exists: /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:45 user nova-compute[72019]: DEBUG nova.network.neutron [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Successfully updated port: af35aee5-c40d-47d2-82ea-3ff57c1d5495 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:16:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "refresh_cache-847e2db8-10a7-416b-ae22-1c75b6d37817" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:16:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquired lock "refresh_cache-847e2db8-10a7-416b-ae22-1c75b6d37817" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:16:45 user nova-compute[72019]: DEBUG nova.network.neutron [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:16:45 user nova-compute[72019]: DEBUG nova.compute.manager [req-abcf23d9-3d98-414d-91d3-30fe30773d2d req-86c8433d-9da0-4d76-85b0-3bb55275dd8c service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Received event network-changed-af35aee5-c40d-47d2-82ea-3ff57c1d5495 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:45 user nova-compute[72019]: DEBUG nova.compute.manager [req-abcf23d9-3d98-414d-91d3-30fe30773d2d req-86c8433d-9da0-4d76-85b0-3bb55275dd8c service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Refreshing instance network info cache due to event network-changed-af35aee5-c40d-47d2-82ea-3ff57c1d5495. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:16:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-abcf23d9-3d98-414d-91d3-30fe30773d2d req-86c8433d-9da0-4d76-85b0-3bb55275dd8c service nova] Acquiring lock "refresh_cache-847e2db8-10a7-416b-ae22-1c75b6d37817" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:16:45 user nova-compute[72019]: DEBUG nova.network.neutron [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:16:45 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Successfully created port: 4c6952bc-e57c-4679-90f3-e9bd66e864ca {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.network.neutron [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Updating instance_info_cache with network_info: [{"id": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "address": "fa:16:3e:76:9e:86", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf35aee5-c4", "ovs_interfaceid": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Releasing lock "refresh_cache-847e2db8-10a7-416b-ae22-1c75b6d37817" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Instance network_info: |[{"id": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "address": "fa:16:3e:76:9e:86", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf35aee5-c4", "ovs_interfaceid": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-abcf23d9-3d98-414d-91d3-30fe30773d2d req-86c8433d-9da0-4d76-85b0-3bb55275dd8c service nova] Acquired lock "refresh_cache-847e2db8-10a7-416b-ae22-1c75b6d37817" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.network.neutron [req-abcf23d9-3d98-414d-91d3-30fe30773d2d req-86c8433d-9da0-4d76-85b0-3bb55275dd8c service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Refreshing network info cache for port af35aee5-c40d-47d2-82ea-3ff57c1d5495 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Start _get_guest_xml network_info=[{"id": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "address": "fa:16:3e:76:9e:86", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf35aee5-c4", "ovs_interfaceid": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:16:46 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:16:46 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-752836267',display_name='tempest-ServersNegativeTestJSON-server-752836267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-752836267',id=18,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4b4e44c0b8945079de567503aab3a12',ramdisk_id='',reservation_id='r-cjbszv20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-548588779',owner_user_name='tempest-ServersNegativeTestJSON-548588779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:16:43Z,user_data=None,user_id='3f713f95191542f6a23ee25669061b27',uuid=847e2db8-10a7-416b-ae22-1c75b6d37817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "address": "fa:16:3e:76:9e:86", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf35aee5-c4", "ovs_interfaceid": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Converting VIF {"id": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "address": "fa:16:3e:76:9e:86", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf35aee5-c4", "ovs_interfaceid": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:9e:86,bridge_name='br-int',has_traffic_filtering=True,id=af35aee5-c40d-47d2-82ea-3ff57c1d5495,network=Network(73061151-2d01-43ae-9ac6-841d71c038ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf35aee5-c4') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.objects.instance [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lazy-loading 'pci_devices' on Instance uuid 847e2db8-10a7-416b-ae22-1c75b6d37817 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:16:46 user nova-compute[72019]:   <uuid>847e2db8-10a7-416b-ae22-1c75b6d37817</uuid>
Apr 14 13:16:46 user nova-compute[72019]:   <name>instance-00000012</name>
Apr 14 13:16:46 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:16:46 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:16:46 user nova-compute[72019]:   <metadata>
Apr 14 13:16:46 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:16:46 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:16:46 user nova-compute[72019]:       <nova:name>tempest-ServersNegativeTestJSON-server-752836267</nova:name>
Apr 14 13:16:46 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:16:46</nova:creationTime>
Apr 14 13:16:46 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:16:46 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:16:46 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:16:46 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:16:46 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:16:46 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:16:46 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:16:46 user nova-compute[72019]:       <nova:owner>
Apr 14 13:16:46 user nova-compute[72019]:         <nova:user uuid="3f713f95191542f6a23ee25669061b27">tempest-ServersNegativeTestJSON-548588779-project-member</nova:user>
Apr 14 13:16:46 user nova-compute[72019]:         <nova:project uuid="d4b4e44c0b8945079de567503aab3a12">tempest-ServersNegativeTestJSON-548588779</nova:project>
Apr 14 13:16:46 user nova-compute[72019]:       </nova:owner>
Apr 14 13:16:46 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:16:46 user nova-compute[72019]:       <nova:ports>
Apr 14 13:16:46 user nova-compute[72019]:         <nova:port uuid="af35aee5-c40d-47d2-82ea-3ff57c1d5495">
Apr 14 13:16:46 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 13:16:46 user nova-compute[72019]:         </nova:port>
Apr 14 13:16:46 user nova-compute[72019]:       </nova:ports>
Apr 14 13:16:46 user nova-compute[72019]:     </nova:instance>
Apr 14 13:16:46 user nova-compute[72019]:   </metadata>
Apr 14 13:16:46 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:16:46 user nova-compute[72019]:     <system>
Apr 14 13:16:46 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:16:46 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:16:46 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:16:46 user nova-compute[72019]:       <entry name="serial">847e2db8-10a7-416b-ae22-1c75b6d37817</entry>
Apr 14 13:16:46 user nova-compute[72019]:       <entry name="uuid">847e2db8-10a7-416b-ae22-1c75b6d37817</entry>
Apr 14 13:16:46 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:16:46 user nova-compute[72019]:     </system>
Apr 14 13:16:46 user nova-compute[72019]:   </sysinfo>
Apr 14 13:16:46 user nova-compute[72019]:   <os>
Apr 14 13:16:46 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:16:46 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:16:46 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:16:46 user nova-compute[72019]:   </os>
Apr 14 13:16:46 user nova-compute[72019]:   <features>
Apr 14 13:16:46 user nova-compute[72019]:     <acpi/>
Apr 14 13:16:46 user nova-compute[72019]:     <apic/>
Apr 14 13:16:46 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:16:46 user nova-compute[72019]:   </features>
Apr 14 13:16:46 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:16:46 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:16:46 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:16:46 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:16:46 user nova-compute[72019]:   </clock>
Apr 14 13:16:46 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:16:46 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:16:46 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:16:46 user nova-compute[72019]:   </cpu>
Apr 14 13:16:46 user nova-compute[72019]:   <devices>
Apr 14 13:16:46 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:16:46 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:16:46 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk"/>
Apr 14 13:16:46 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:16:46 user nova-compute[72019]:     </disk>
Apr 14 13:16:46 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:16:46 user nova-compute[72019]:       <mac address="fa:16:3e:76:9e:86"/>
Apr 14 13:16:46 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:16:46 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:16:46 user nova-compute[72019]:       <target dev="tapaf35aee5-c4"/>
Apr 14 13:16:46 user nova-compute[72019]:     </interface>
Apr 14 13:16:46 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:16:46 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/console.log" append="off"/>
Apr 14 13:16:46 user nova-compute[72019]:     </serial>
Apr 14 13:16:46 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:16:46 user nova-compute[72019]:     <video>
Apr 14 13:16:46 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:16:46 user nova-compute[72019]:     </video>
Apr 14 13:16:46 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:16:46 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:16:46 user nova-compute[72019]:     </rng>
Apr 14 13:16:46 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:16:46 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:16:46 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:16:46 user nova-compute[72019]:     </memballoon>
Apr 14 13:16:46 user nova-compute[72019]:   </devices>
Apr 14 13:16:46 user nova-compute[72019]: </domain>
Apr 14 13:16:46 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-752836267',display_name='tempest-ServersNegativeTestJSON-server-752836267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-752836267',id=18,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4b4e44c0b8945079de567503aab3a12',ramdisk_id='',reservation_id='r-cjbszv20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-548588779',owner_user_name='tempest-ServersNegativeTestJSON-548588779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:16:43Z,user_data=None,user_id='3f713f95191542f6a23ee25669061b27',uuid=847e2db8-10a7-416b-ae22-1c75b6d37817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "address": "fa:16:3e:76:9e:86", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf35aee5-c4", "ovs_interfaceid": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Converting VIF {"id": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "address": "fa:16:3e:76:9e:86", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf35aee5-c4", "ovs_interfaceid": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:9e:86,bridge_name='br-int',has_traffic_filtering=True,id=af35aee5-c40d-47d2-82ea-3ff57c1d5495,network=Network(73061151-2d01-43ae-9ac6-841d71c038ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf35aee5-c4') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG os_vif [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:9e:86,bridge_name='br-int',has_traffic_filtering=True,id=af35aee5-c40d-47d2-82ea-3ff57c1d5495,network=Network(73061151-2d01-43ae-9ac6-841d71c038ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf35aee5-c4') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf35aee5-c4, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf35aee5-c4, col_values=(('external_ids', {'iface-id': 'af35aee5-c40d-47d2-82ea-3ff57c1d5495', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:9e:86', 'vm-uuid': '847e2db8-10a7-416b-ae22-1c75b6d37817'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:46 user nova-compute[72019]: INFO os_vif [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:9e:86,bridge_name='br-int',has_traffic_filtering=True,id=af35aee5-c40d-47d2-82ea-3ff57c1d5495,network=Network(73061151-2d01-43ae-9ac6-841d71c038ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf35aee5-c4')
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] No VIF found with MAC fa:16:3e:76:9e:86, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.network.neutron [req-abcf23d9-3d98-414d-91d3-30fe30773d2d req-86c8433d-9da0-4d76-85b0-3bb55275dd8c service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Updated VIF entry in instance network info cache for port af35aee5-c40d-47d2-82ea-3ff57c1d5495. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.network.neutron [req-abcf23d9-3d98-414d-91d3-30fe30773d2d req-86c8433d-9da0-4d76-85b0-3bb55275dd8c service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Updating instance_info_cache with network_info: [{"id": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "address": "fa:16:3e:76:9e:86", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf35aee5-c4", "ovs_interfaceid": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-abcf23d9-3d98-414d-91d3-30fe30773d2d req-86c8433d-9da0-4d76-85b0-3bb55275dd8c service nova] Releasing lock "refresh_cache-847e2db8-10a7-416b-ae22-1c75b6d37817" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Successfully updated port: 4c6952bc-e57c-4679-90f3-e9bd66e864ca {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquired lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:16:46 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Updating instance_info_cache with network_info: [{"id": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "address": "fa:16:3e:7a:a4:82", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6952bc-e5", "ovs_interfaceid": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Releasing lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Instance network_info: |[{"id": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "address": "fa:16:3e:7a:a4:82", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6952bc-e5", "ovs_interfaceid": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Start _get_guest_xml network_info=[{"id": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "address": "fa:16:3e:7a:a4:82", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6952bc-e5", "ovs_interfaceid": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:16:47 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:16:47 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1191459632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1191459632',id=19,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a573d19b775642bba2f2883e0005492d',ramdisk_id='',reservation_id='r-7i0o2yys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-740277424',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:16:44Z,user_data=None,user_id='ebc2d46bc1794568841df20b046356c7',uuid=978f6fc8-1080-4840-ab8a-e025efe4f906,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "address": "fa:16:3e:7a:a4:82", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6952bc-e5", "ovs_interfaceid": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converting VIF {"id": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "address": "fa:16:3e:7a:a4:82", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6952bc-e5", "ovs_interfaceid": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a4:82,bridge_name='br-int',has_traffic_filtering=True,id=4c6952bc-e57c-4679-90f3-e9bd66e864ca,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6952bc-e5') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'pci_devices' on Instance uuid 978f6fc8-1080-4840-ab8a-e025efe4f906 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:16:47 user nova-compute[72019]:   <uuid>978f6fc8-1080-4840-ab8a-e025efe4f906</uuid>
Apr 14 13:16:47 user nova-compute[72019]:   <name>instance-00000013</name>
Apr 14 13:16:47 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:16:47 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:16:47 user nova-compute[72019]:   <metadata>
Apr 14 13:16:47 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:16:47 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:16:47 user nova-compute[72019]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1191459632</nova:name>
Apr 14 13:16:47 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:16:47</nova:creationTime>
Apr 14 13:16:47 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:16:47 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:16:47 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:16:47 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:16:47 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:16:47 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:16:47 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:16:47 user nova-compute[72019]:       <nova:owner>
Apr 14 13:16:47 user nova-compute[72019]:         <nova:user uuid="ebc2d46bc1794568841df20b046356c7">tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member</nova:user>
Apr 14 13:16:47 user nova-compute[72019]:         <nova:project uuid="a573d19b775642bba2f2883e0005492d">tempest-ServerBootFromVolumeStableRescueTest-740277424</nova:project>
Apr 14 13:16:47 user nova-compute[72019]:       </nova:owner>
Apr 14 13:16:47 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:16:47 user nova-compute[72019]:       <nova:ports>
Apr 14 13:16:47 user nova-compute[72019]:         <nova:port uuid="4c6952bc-e57c-4679-90f3-e9bd66e864ca">
Apr 14 13:16:47 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 13:16:47 user nova-compute[72019]:         </nova:port>
Apr 14 13:16:47 user nova-compute[72019]:       </nova:ports>
Apr 14 13:16:47 user nova-compute[72019]:     </nova:instance>
Apr 14 13:16:47 user nova-compute[72019]:   </metadata>
Apr 14 13:16:47 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:16:47 user nova-compute[72019]:     <system>
Apr 14 13:16:47 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:16:47 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:16:47 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:16:47 user nova-compute[72019]:       <entry name="serial">978f6fc8-1080-4840-ab8a-e025efe4f906</entry>
Apr 14 13:16:47 user nova-compute[72019]:       <entry name="uuid">978f6fc8-1080-4840-ab8a-e025efe4f906</entry>
Apr 14 13:16:47 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:16:47 user nova-compute[72019]:     </system>
Apr 14 13:16:47 user nova-compute[72019]:   </sysinfo>
Apr 14 13:16:47 user nova-compute[72019]:   <os>
Apr 14 13:16:47 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:16:47 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:16:47 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:16:47 user nova-compute[72019]:   </os>
Apr 14 13:16:47 user nova-compute[72019]:   <features>
Apr 14 13:16:47 user nova-compute[72019]:     <acpi/>
Apr 14 13:16:47 user nova-compute[72019]:     <apic/>
Apr 14 13:16:47 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:16:47 user nova-compute[72019]:   </features>
Apr 14 13:16:47 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:16:47 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:16:47 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:16:47 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:16:47 user nova-compute[72019]:   </clock>
Apr 14 13:16:47 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:16:47 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:16:47 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:16:47 user nova-compute[72019]:   </cpu>
Apr 14 13:16:47 user nova-compute[72019]:   <devices>
Apr 14 13:16:47 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:16:47 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:16:47 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk"/>
Apr 14 13:16:47 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:16:47 user nova-compute[72019]:     </disk>
Apr 14 13:16:47 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:16:47 user nova-compute[72019]:       <mac address="fa:16:3e:7a:a4:82"/>
Apr 14 13:16:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:16:47 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:16:47 user nova-compute[72019]:       <target dev="tap4c6952bc-e5"/>
Apr 14 13:16:47 user nova-compute[72019]:     </interface>
Apr 14 13:16:47 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:16:47 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/console.log" append="off"/>
Apr 14 13:16:47 user nova-compute[72019]:     </serial>
Apr 14 13:16:47 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:16:47 user nova-compute[72019]:     <video>
Apr 14 13:16:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:16:47 user nova-compute[72019]:     </video>
Apr 14 13:16:47 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:16:47 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:16:47 user nova-compute[72019]:     </rng>
Apr 14 13:16:47 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:16:47 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:16:47 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:16:47 user nova-compute[72019]:     </memballoon>
Apr 14 13:16:47 user nova-compute[72019]:   </devices>
Apr 14 13:16:47 user nova-compute[72019]: </domain>
Apr 14 13:16:47 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1191459632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1191459632',id=19,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a573d19b775642bba2f2883e0005492d',ramdisk_id='',reservation_id='r-7i0o2yys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-740277424',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:16:44Z,user_data=None,user_id='ebc2d46bc1794568841df20b046356c7',uuid=978f6fc8-1080-4840-ab8a-e025efe4f906,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "address": "fa:16:3e:7a:a4:82", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6952bc-e5", "ovs_interfaceid": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converting VIF {"id": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "address": "fa:16:3e:7a:a4:82", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6952bc-e5", "ovs_interfaceid": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a4:82,bridge_name='br-int',has_traffic_filtering=True,id=4c6952bc-e57c-4679-90f3-e9bd66e864ca,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6952bc-e5') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG os_vif [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a4:82,bridge_name='br-int',has_traffic_filtering=True,id=4c6952bc-e57c-4679-90f3-e9bd66e864ca,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6952bc-e5') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c6952bc-e5, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c6952bc-e5, col_values=(('external_ids', {'iface-id': '4c6952bc-e57c-4679-90f3-e9bd66e864ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:a4:82', 'vm-uuid': '978f6fc8-1080-4840-ab8a-e025efe4f906'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:47 user nova-compute[72019]: INFO os_vif [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a4:82,bridge_name='br-int',has_traffic_filtering=True,id=4c6952bc-e57c-4679-90f3-e9bd66e864ca,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6952bc-e5')
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] No VIF found with MAC fa:16:3e:7a:a4:82, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-87a39ff5-f79b-409d-a215-96e5ff1191fa req-81b69784-d80b-478c-8c30-cdd4097c5842 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Received event network-changed-4c6952bc-e57c-4679-90f3-e9bd66e864ca {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-87a39ff5-f79b-409d-a215-96e5ff1191fa req-81b69784-d80b-478c-8c30-cdd4097c5842 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Refreshing instance network info cache due to event network-changed-4c6952bc-e57c-4679-90f3-e9bd66e864ca. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-87a39ff5-f79b-409d-a215-96e5ff1191fa req-81b69784-d80b-478c-8c30-cdd4097c5842 service nova] Acquiring lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-87a39ff5-f79b-409d-a215-96e5ff1191fa req-81b69784-d80b-478c-8c30-cdd4097c5842 service nova] Acquired lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.network.neutron [req-87a39ff5-f79b-409d-a215-96e5ff1191fa req-81b69784-d80b-478c-8c30-cdd4097c5842 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Refreshing network info cache for port 4c6952bc-e57c-4679-90f3-e9bd66e864ca {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-aa805cc1-45b6-4094-a5e2-75ed8cb9bf4f req-9632b3b0-0370-41e1-847c-747e921e316a service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Received event network-vif-plugged-af35aee5-c40d-47d2-82ea-3ff57c1d5495 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aa805cc1-45b6-4094-a5e2-75ed8cb9bf4f req-9632b3b0-0370-41e1-847c-747e921e316a service nova] Acquiring lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aa805cc1-45b6-4094-a5e2-75ed8cb9bf4f req-9632b3b0-0370-41e1-847c-747e921e316a service nova] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aa805cc1-45b6-4094-a5e2-75ed8cb9bf4f req-9632b3b0-0370-41e1-847c-747e921e316a service nova] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-aa805cc1-45b6-4094-a5e2-75ed8cb9bf4f req-9632b3b0-0370-41e1-847c-747e921e316a service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] No waiting events found dispatching network-vif-plugged-af35aee5-c40d-47d2-82ea-3ff57c1d5495 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:16:47 user nova-compute[72019]: WARNING nova.compute.manager [req-aa805cc1-45b6-4094-a5e2-75ed8cb9bf4f req-9632b3b0-0370-41e1-847c-747e921e316a service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Received unexpected event network-vif-plugged-af35aee5-c40d-47d2-82ea-3ff57c1d5495 for instance with vm_state building and task_state spawning.
Apr 14 13:16:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-87a39ff5-f79b-409d-a215-96e5ff1191fa req-81b69784-d80b-478c-8c30-cdd4097c5842 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Updated VIF entry in instance network info cache for port 4c6952bc-e57c-4679-90f3-e9bd66e864ca. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:16:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-87a39ff5-f79b-409d-a215-96e5ff1191fa req-81b69784-d80b-478c-8c30-cdd4097c5842 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Updating instance_info_cache with network_info: [{"id": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "address": "fa:16:3e:7a:a4:82", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6952bc-e5", "ovs_interfaceid": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:16:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-87a39ff5-f79b-409d-a215-96e5ff1191fa req-81b69784-d80b-478c-8c30-cdd4097c5842 service nova] Releasing lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:16:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Received event network-vif-plugged-af35aee5-c40d-47d2-82ea-3ff57c1d5495 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Acquiring lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] No waiting events found dispatching network-vif-plugged-af35aee5-c40d-47d2-82ea-3ff57c1d5495 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:16:50 user nova-compute[72019]: WARNING nova.compute.manager [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Received unexpected event network-vif-plugged-af35aee5-c40d-47d2-82ea-3ff57c1d5495 for instance with vm_state building and task_state spawning.
Apr 14 13:16:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Received event network-vif-plugged-4c6952bc-e57c-4679-90f3-e9bd66e864ca {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Acquiring lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] No waiting events found dispatching network-vif-plugged-4c6952bc-e57c-4679-90f3-e9bd66e864ca {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:16:50 user nova-compute[72019]: WARNING nova.compute.manager [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Received unexpected event network-vif-plugged-4c6952bc-e57c-4679-90f3-e9bd66e864ca for instance with vm_state building and task_state spawning.
Apr 14 13:16:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Received event network-vif-plugged-4c6952bc-e57c-4679-90f3-e9bd66e864ca {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Acquiring lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] No waiting events found dispatching network-vif-plugged-4c6952bc-e57c-4679-90f3-e9bd66e864ca {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:16:50 user nova-compute[72019]: WARNING nova.compute.manager [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Received unexpected event network-vif-plugged-4c6952bc-e57c-4679-90f3-e9bd66e864ca for instance with vm_state building and task_state spawning.
Apr 14 13:16:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478211.3142984, 847e2db8-10a7-416b-ae22-1c75b6d37817 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:16:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] VM Resumed (Lifecycle Event)
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:16:51 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Instance spawned successfully.
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:16:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478211.3158162, 847e2db8-10a7-416b-ae22-1c75b6d37817 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:16:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] VM Started (Lifecycle Event)
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:16:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:16:51 user nova-compute[72019]: INFO nova.compute.manager [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Took 8.32 seconds to spawn the instance on the hypervisor.
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:16:51 user nova-compute[72019]: INFO nova.compute.manager [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Took 9.11 seconds to build instance.
Apr 14 13:16:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.198s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478211.7820053, 978f6fc8-1080-4840-ab8a-e025efe4f906 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:16:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] VM Resumed (Lifecycle Event)
Apr 14 13:16:51 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Instance spawned successfully.
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:16:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478211.7840972, 978f6fc8-1080-4840-ab8a-e025efe4f906 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:16:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] VM Started (Lifecycle Event)
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:16:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:16:51 user nova-compute[72019]: INFO nova.compute.manager [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Took 7.81 seconds to spawn the instance on the hypervisor.
Apr 14 13:16:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:16:51 user nova-compute[72019]: INFO nova.compute.manager [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Took 8.66 seconds to build instance.
Apr 14 13:16:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.782s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:16:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:53 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478198.396441, 24179ea7-82e2-48fd-9aab-2e3bf7edb372 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:16:53 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] VM Stopped (Lifecycle Event)
Apr 14 13:16:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-947167d5-5dd6-4022-bb0e-4af336a36a51 None None] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:16:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:16:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:59 user nova-compute[72019]: DEBUG nova.compute.manager [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:16:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:16:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:16:59 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:16:59 user nova-compute[72019]: INFO nova.compute.claims [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Claim successful on node user
Apr 14 13:16:59 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:16:59 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG nova.compute.manager [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG nova.compute.manager [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG nova.network.neutron [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:17:00 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:17:00 user nova-compute[72019]: DEBUG nova.compute.manager [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG nova.compute.manager [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:17:00 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Creating image(s)
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "/opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "/opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.159s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.158s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG nova.policy [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f3445d14b0a44fd999bc2fc875c77bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe64d1d65224162b60849eace352cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk 1073741824" returned: 0 in 0.066s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.167s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:17:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:01 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Cannot resize image /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:17:01 user nova-compute[72019]: DEBUG nova.objects.instance [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lazy-loading 'migration_context' on Instance uuid 2c051c82-e56a-4a50-a24b-23eb2136f3ee {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:17:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Ensure instance console log exists: /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:17:01 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:01 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:01 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:02 user nova-compute[72019]: DEBUG nova.network.neutron [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Successfully created port: 18490e88-a837-4ac8-a475-885551bb6219 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:17:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:03 user nova-compute[72019]: DEBUG nova.network.neutron [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Successfully updated port: 18490e88-a837-4ac8-a475-885551bb6219 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:17:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "refresh_cache-2c051c82-e56a-4a50-a24b-23eb2136f3ee" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:17:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquired lock "refresh_cache-2c051c82-e56a-4a50-a24b-23eb2136f3ee" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:17:03 user nova-compute[72019]: DEBUG nova.network.neutron [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:17:03 user nova-compute[72019]: DEBUG nova.compute.manager [req-d0c2e43e-ec7f-458f-8e1a-b913129bf4f3 req-253aba32-1c70-424f-b52d-134957d61b7e service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Received event network-changed-18490e88-a837-4ac8-a475-885551bb6219 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:03 user nova-compute[72019]: DEBUG nova.compute.manager [req-d0c2e43e-ec7f-458f-8e1a-b913129bf4f3 req-253aba32-1c70-424f-b52d-134957d61b7e service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Refreshing instance network info cache due to event network-changed-18490e88-a837-4ac8-a475-885551bb6219. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:17:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d0c2e43e-ec7f-458f-8e1a-b913129bf4f3 req-253aba32-1c70-424f-b52d-134957d61b7e service nova] Acquiring lock "refresh_cache-2c051c82-e56a-4a50-a24b-23eb2136f3ee" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:17:03 user nova-compute[72019]: DEBUG nova.network.neutron [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.network.neutron [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Updating instance_info_cache with network_info: [{"id": "18490e88-a837-4ac8-a475-885551bb6219", "address": "fa:16:3e:62:a4:a3", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18490e88-a8", "ovs_interfaceid": "18490e88-a837-4ac8-a475-885551bb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Releasing lock "refresh_cache-2c051c82-e56a-4a50-a24b-23eb2136f3ee" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.compute.manager [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Instance network_info: |[{"id": "18490e88-a837-4ac8-a475-885551bb6219", "address": "fa:16:3e:62:a4:a3", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18490e88-a8", "ovs_interfaceid": "18490e88-a837-4ac8-a475-885551bb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d0c2e43e-ec7f-458f-8e1a-b913129bf4f3 req-253aba32-1c70-424f-b52d-134957d61b7e service nova] Acquired lock "refresh_cache-2c051c82-e56a-4a50-a24b-23eb2136f3ee" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.network.neutron [req-d0c2e43e-ec7f-458f-8e1a-b913129bf4f3 req-253aba32-1c70-424f-b52d-134957d61b7e service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Refreshing network info cache for port 18490e88-a837-4ac8-a475-885551bb6219 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Start _get_guest_xml network_info=[{"id": "18490e88-a837-4ac8-a475-885551bb6219", "address": "fa:16:3e:62:a4:a3", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18490e88-a8", "ovs_interfaceid": "18490e88-a837-4ac8-a475-885551bb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:17:04 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:17:04 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1047339648',display_name='tempest-VolumesSnapshotTestJSON-instance-1047339648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1047339648',id=20,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fe64d1d65224162b60849eace352cb4',ramdisk_id='',reservation_id='r-qjpuolxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1137775211',owner_user_name='tempest-VolumesSnapshotTestJSON-1137775211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:17:00Z,user_data=None,user_id='0f3445d14b0a44fd999bc2fc875c77bb',uuid=2c051c82-e56a-4a50-a24b-23eb2136f3ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18490e88-a837-4ac8-a475-885551bb6219", "address": "fa:16:3e:62:a4:a3", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18490e88-a8", "ovs_interfaceid": "18490e88-a837-4ac8-a475-885551bb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Converting VIF {"id": "18490e88-a837-4ac8-a475-885551bb6219", "address": "fa:16:3e:62:a4:a3", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18490e88-a8", "ovs_interfaceid": "18490e88-a837-4ac8-a475-885551bb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a4:a3,bridge_name='br-int',has_traffic_filtering=True,id=18490e88-a837-4ac8-a475-885551bb6219,network=Network(548d2c7a-ae94-4d89-8980-cb14f224fca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18490e88-a8') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.objects.instance [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c051c82-e56a-4a50-a24b-23eb2136f3ee {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:17:04 user nova-compute[72019]:   <uuid>2c051c82-e56a-4a50-a24b-23eb2136f3ee</uuid>
Apr 14 13:17:04 user nova-compute[72019]:   <name>instance-00000014</name>
Apr 14 13:17:04 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:17:04 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:17:04 user nova-compute[72019]:   <metadata>
Apr 14 13:17:04 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:17:04 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:17:04 user nova-compute[72019]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1047339648</nova:name>
Apr 14 13:17:04 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:17:04</nova:creationTime>
Apr 14 13:17:04 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:17:04 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:17:04 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:17:04 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:17:04 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:17:04 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:17:04 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:17:04 user nova-compute[72019]:       <nova:owner>
Apr 14 13:17:04 user nova-compute[72019]:         <nova:user uuid="0f3445d14b0a44fd999bc2fc875c77bb">tempest-VolumesSnapshotTestJSON-1137775211-project-member</nova:user>
Apr 14 13:17:04 user nova-compute[72019]:         <nova:project uuid="4fe64d1d65224162b60849eace352cb4">tempest-VolumesSnapshotTestJSON-1137775211</nova:project>
Apr 14 13:17:04 user nova-compute[72019]:       </nova:owner>
Apr 14 13:17:04 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:17:04 user nova-compute[72019]:       <nova:ports>
Apr 14 13:17:04 user nova-compute[72019]:         <nova:port uuid="18490e88-a837-4ac8-a475-885551bb6219">
Apr 14 13:17:04 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 13:17:04 user nova-compute[72019]:         </nova:port>
Apr 14 13:17:04 user nova-compute[72019]:       </nova:ports>
Apr 14 13:17:04 user nova-compute[72019]:     </nova:instance>
Apr 14 13:17:04 user nova-compute[72019]:   </metadata>
Apr 14 13:17:04 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:17:04 user nova-compute[72019]:     <system>
Apr 14 13:17:04 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:17:04 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:17:04 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:17:04 user nova-compute[72019]:       <entry name="serial">2c051c82-e56a-4a50-a24b-23eb2136f3ee</entry>
Apr 14 13:17:04 user nova-compute[72019]:       <entry name="uuid">2c051c82-e56a-4a50-a24b-23eb2136f3ee</entry>
Apr 14 13:17:04 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:17:04 user nova-compute[72019]:     </system>
Apr 14 13:17:04 user nova-compute[72019]:   </sysinfo>
Apr 14 13:17:04 user nova-compute[72019]:   <os>
Apr 14 13:17:04 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:17:04 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:17:04 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:17:04 user nova-compute[72019]:   </os>
Apr 14 13:17:04 user nova-compute[72019]:   <features>
Apr 14 13:17:04 user nova-compute[72019]:     <acpi/>
Apr 14 13:17:04 user nova-compute[72019]:     <apic/>
Apr 14 13:17:04 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:17:04 user nova-compute[72019]:   </features>
Apr 14 13:17:04 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:17:04 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:17:04 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:17:04 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:17:04 user nova-compute[72019]:   </clock>
Apr 14 13:17:04 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:17:04 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:17:04 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:17:04 user nova-compute[72019]:   </cpu>
Apr 14 13:17:04 user nova-compute[72019]:   <devices>
Apr 14 13:17:04 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:17:04 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:17:04 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk"/>
Apr 14 13:17:04 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:17:04 user nova-compute[72019]:     </disk>
Apr 14 13:17:04 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:17:04 user nova-compute[72019]:       <mac address="fa:16:3e:62:a4:a3"/>
Apr 14 13:17:04 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:17:04 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:17:04 user nova-compute[72019]:       <target dev="tap18490e88-a8"/>
Apr 14 13:17:04 user nova-compute[72019]:     </interface>
Apr 14 13:17:04 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:17:04 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/console.log" append="off"/>
Apr 14 13:17:04 user nova-compute[72019]:     </serial>
Apr 14 13:17:04 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:17:04 user nova-compute[72019]:     <video>
Apr 14 13:17:04 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:17:04 user nova-compute[72019]:     </video>
Apr 14 13:17:04 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:17:04 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:17:04 user nova-compute[72019]:     </rng>
Apr 14 13:17:04 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:17:04 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:17:04 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:17:04 user nova-compute[72019]:     </memballoon>
Apr 14 13:17:04 user nova-compute[72019]:   </devices>
Apr 14 13:17:04 user nova-compute[72019]: </domain>
Apr 14 13:17:04 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1047339648',display_name='tempest-VolumesSnapshotTestJSON-instance-1047339648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1047339648',id=20,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fe64d1d65224162b60849eace352cb4',ramdisk_id='',reservation_id='r-qjpuolxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1137775211',owner_user_name='tempest-VolumesSnapshotTestJSON-1137775211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:17:00Z,user_data=None,user_id='0f3445d14b0a44fd999bc2fc875c77bb',uuid=2c051c82-e56a-4a50-a24b-23eb2136f3ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18490e88-a837-4ac8-a475-885551bb6219", "address": "fa:16:3e:62:a4:a3", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18490e88-a8", "ovs_interfaceid": "18490e88-a837-4ac8-a475-885551bb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Converting VIF {"id": "18490e88-a837-4ac8-a475-885551bb6219", "address": "fa:16:3e:62:a4:a3", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18490e88-a8", "ovs_interfaceid": "18490e88-a837-4ac8-a475-885551bb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a4:a3,bridge_name='br-int',has_traffic_filtering=True,id=18490e88-a837-4ac8-a475-885551bb6219,network=Network(548d2c7a-ae94-4d89-8980-cb14f224fca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18490e88-a8') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG os_vif [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a4:a3,bridge_name='br-int',has_traffic_filtering=True,id=18490e88-a837-4ac8-a475-885551bb6219,network=Network(548d2c7a-ae94-4d89-8980-cb14f224fca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18490e88-a8') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18490e88-a8, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18490e88-a8, col_values=(('external_ids', {'iface-id': '18490e88-a837-4ac8-a475-885551bb6219', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:a4:a3', 'vm-uuid': '2c051c82-e56a-4a50-a24b-23eb2136f3ee'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:04 user nova-compute[72019]: INFO os_vif [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a4:a3,bridge_name='br-int',has_traffic_filtering=True,id=18490e88-a837-4ac8-a475-885551bb6219,network=Network(548d2c7a-ae94-4d89-8980-cb14f224fca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18490e88-a8')
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:17:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] No VIF found with MAC fa:16:3e:62:a4:a3, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:17:05 user nova-compute[72019]: DEBUG nova.network.neutron [req-d0c2e43e-ec7f-458f-8e1a-b913129bf4f3 req-253aba32-1c70-424f-b52d-134957d61b7e service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Updated VIF entry in instance network info cache for port 18490e88-a837-4ac8-a475-885551bb6219. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:17:05 user nova-compute[72019]: DEBUG nova.network.neutron [req-d0c2e43e-ec7f-458f-8e1a-b913129bf4f3 req-253aba32-1c70-424f-b52d-134957d61b7e service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Updating instance_info_cache with network_info: [{"id": "18490e88-a837-4ac8-a475-885551bb6219", "address": "fa:16:3e:62:a4:a3", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18490e88-a8", "ovs_interfaceid": "18490e88-a837-4ac8-a475-885551bb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:17:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d0c2e43e-ec7f-458f-8e1a-b913129bf4f3 req-253aba32-1c70-424f-b52d-134957d61b7e service nova] Releasing lock "refresh_cache-2c051c82-e56a-4a50-a24b-23eb2136f3ee" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:17:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-ee9d3226-1c89-4fbd-a211-c4dcfd515d98 req-5256f254-1181-4f1a-9df8-ebaad8d18607 service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Received event network-vif-plugged-18490e88-a837-4ac8-a475-885551bb6219 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ee9d3226-1c89-4fbd-a211-c4dcfd515d98 req-5256f254-1181-4f1a-9df8-ebaad8d18607 service nova] Acquiring lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ee9d3226-1c89-4fbd-a211-c4dcfd515d98 req-5256f254-1181-4f1a-9df8-ebaad8d18607 service nova] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ee9d3226-1c89-4fbd-a211-c4dcfd515d98 req-5256f254-1181-4f1a-9df8-ebaad8d18607 service nova] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-ee9d3226-1c89-4fbd-a211-c4dcfd515d98 req-5256f254-1181-4f1a-9df8-ebaad8d18607 service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] No waiting events found dispatching network-vif-plugged-18490e88-a837-4ac8-a475-885551bb6219 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:06 user nova-compute[72019]: WARNING nova.compute.manager [req-ee9d3226-1c89-4fbd-a211-c4dcfd515d98 req-5256f254-1181-4f1a-9df8-ebaad8d18607 service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Received unexpected event network-vif-plugged-18490e88-a837-4ac8-a475-885551bb6219 for instance with vm_state building and task_state spawning.
Apr 14 13:17:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478228.4475467, 2c051c82-e56a-4a50-a24b-23eb2136f3ee => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:17:08 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] VM Resumed (Lifecycle Event)
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:08 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Instance spawned successfully.
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:17:08 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478228.4489596, 2c051c82-e56a-4a50-a24b-23eb2136f3ee => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:17:08 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] VM Started (Lifecycle Event)
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:17:08 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:17:08 user nova-compute[72019]: INFO nova.compute.manager [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Took 8.25 seconds to spawn the instance on the hypervisor.
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:08 user nova-compute[72019]: INFO nova.compute.manager [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Took 9.22 seconds to build instance.
Apr 14 13:17:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.356s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.compute.manager [req-e500a3c3-bd41-4fe1-9988-48b5e3091700 req-e8c9f072-4235-445b-9bb9-8c80a96d2e12 service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Received event network-vif-plugged-18490e88-a837-4ac8-a475-885551bb6219 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e500a3c3-bd41-4fe1-9988-48b5e3091700 req-e8c9f072-4235-445b-9bb9-8c80a96d2e12 service nova] Acquiring lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e500a3c3-bd41-4fe1-9988-48b5e3091700 req-e8c9f072-4235-445b-9bb9-8c80a96d2e12 service nova] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e500a3c3-bd41-4fe1-9988-48b5e3091700 req-e8c9f072-4235-445b-9bb9-8c80a96d2e12 service nova] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:08 user nova-compute[72019]: DEBUG nova.compute.manager [req-e500a3c3-bd41-4fe1-9988-48b5e3091700 req-e8c9f072-4235-445b-9bb9-8c80a96d2e12 service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] No waiting events found dispatching network-vif-plugged-18490e88-a837-4ac8-a475-885551bb6219 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:08 user nova-compute[72019]: WARNING nova.compute.manager [req-e500a3c3-bd41-4fe1-9988-48b5e3091700 req-e8c9f072-4235-445b-9bb9-8c80a96d2e12 service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Received unexpected event network-vif-plugged-18490e88-a837-4ac8-a475-885551bb6219 for instance with vm_state active and task_state None.
Apr 14 13:17:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:18 user nova-compute[72019]: INFO nova.compute.manager [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Rescuing
Apr 14 13:17:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:17:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquired lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:17:18 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:17:18 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Updating instance_info_cache with network_info: [{"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:17:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Releasing lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-367a5748-f3e4-4278-b9c8-f5be5e68f1d5 req-4bb1d554-c074-4d60-83da-cad3cd782756 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-vif-unplugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-367a5748-f3e4-4278-b9c8-f5be5e68f1d5 req-4bb1d554-c074-4d60-83da-cad3cd782756 service nova] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-367a5748-f3e4-4278-b9c8-f5be5e68f1d5 req-4bb1d554-c074-4d60-83da-cad3cd782756 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-367a5748-f3e4-4278-b9c8-f5be5e68f1d5 req-4bb1d554-c074-4d60-83da-cad3cd782756 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-367a5748-f3e4-4278-b9c8-f5be5e68f1d5 req-4bb1d554-c074-4d60-83da-cad3cd782756 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] No waiting events found dispatching network-vif-unplugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:19 user nova-compute[72019]: WARNING nova.compute.manager [req-367a5748-f3e4-4278-b9c8-f5be5e68f1d5 req-4bb1d554-c074-4d60-83da-cad3cd782756 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received unexpected event network-vif-unplugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance with vm_state active and task_state rescuing.
Apr 14 13:17:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Instance destroyed successfully.
Apr 14 13:17:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Attempting rescue
Apr 14 13:17:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72019) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Instance directory exists: not creating {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 13:17:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Creating image(s)
Apr 14 13:17:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "/opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "/opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "/opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'trusted_certs' on Instance uuid 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.159s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.rescue {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.rescue" returned: 0 in 0.061s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:19 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'migration_context' on Instance uuid 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Start _get_guest_xml network_info=[{"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "vif_mac": "fa:16:3e:4e:26:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'resources' on Instance uuid 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'numa_topology' on Instance uuid 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:20 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:17:20 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'vcpu_model' on Instance uuid 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-299687148',display_name='tempest-ServerRescueNegativeTestJSON-server-299687148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-299687148',id=3,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:12:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7c8c8f620334166a141ea65525ba2a0',ramdisk_id='',reservation_id='r-876svson',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1698214771',owner_user_name='tempest-ServerRescueNegativeTestJSON-1698214771-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:12:49Z,user_data=None,user_id='3948b7c643374bcdbeb34f0f2f790c3c',uuid=29dc5faa-e15a-425c-80f8-ddb4f34f43d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "vif_mac": "fa:16:3e:4e:26:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converting VIF {"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "vif_mac": "fa:16:3e:4e:26:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:26:54,bridge_name='br-int',has_traffic_filtering=True,id=f15f52ef-e473-4957-8be2-8c3ef6a9aa16,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15f52ef-e4') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'pci_devices' on Instance uuid 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:17:20 user nova-compute[72019]:   <uuid>29dc5faa-e15a-425c-80f8-ddb4f34f43d4</uuid>
Apr 14 13:17:20 user nova-compute[72019]:   <name>instance-00000003</name>
Apr 14 13:17:20 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:17:20 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:17:20 user nova-compute[72019]:   <metadata>
Apr 14 13:17:20 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:17:20 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:17:20 user nova-compute[72019]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-299687148</nova:name>
Apr 14 13:17:20 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:17:20</nova:creationTime>
Apr 14 13:17:20 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:17:20 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:17:20 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:17:20 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:17:20 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:17:20 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:17:20 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:17:20 user nova-compute[72019]:       <nova:owner>
Apr 14 13:17:20 user nova-compute[72019]:         <nova:user uuid="3948b7c643374bcdbeb34f0f2f790c3c">tempest-ServerRescueNegativeTestJSON-1698214771-project-member</nova:user>
Apr 14 13:17:20 user nova-compute[72019]:         <nova:project uuid="a7c8c8f620334166a141ea65525ba2a0">tempest-ServerRescueNegativeTestJSON-1698214771</nova:project>
Apr 14 13:17:20 user nova-compute[72019]:       </nova:owner>
Apr 14 13:17:20 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:17:20 user nova-compute[72019]:       <nova:ports>
Apr 14 13:17:20 user nova-compute[72019]:         <nova:port uuid="f15f52ef-e473-4957-8be2-8c3ef6a9aa16">
Apr 14 13:17:20 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 13:17:20 user nova-compute[72019]:         </nova:port>
Apr 14 13:17:20 user nova-compute[72019]:       </nova:ports>
Apr 14 13:17:20 user nova-compute[72019]:     </nova:instance>
Apr 14 13:17:20 user nova-compute[72019]:   </metadata>
Apr 14 13:17:20 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:17:20 user nova-compute[72019]:     <system>
Apr 14 13:17:20 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:17:20 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:17:20 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:17:20 user nova-compute[72019]:       <entry name="serial">29dc5faa-e15a-425c-80f8-ddb4f34f43d4</entry>
Apr 14 13:17:20 user nova-compute[72019]:       <entry name="uuid">29dc5faa-e15a-425c-80f8-ddb4f34f43d4</entry>
Apr 14 13:17:20 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:17:20 user nova-compute[72019]:     </system>
Apr 14 13:17:20 user nova-compute[72019]:   </sysinfo>
Apr 14 13:17:20 user nova-compute[72019]:   <os>
Apr 14 13:17:20 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:17:20 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:17:20 user nova-compute[72019]:   </os>
Apr 14 13:17:20 user nova-compute[72019]:   <features>
Apr 14 13:17:20 user nova-compute[72019]:     <acpi/>
Apr 14 13:17:20 user nova-compute[72019]:     <apic/>
Apr 14 13:17:20 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:17:20 user nova-compute[72019]:   </features>
Apr 14 13:17:20 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:17:20 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:17:20 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:17:20 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:17:20 user nova-compute[72019]:   </clock>
Apr 14 13:17:20 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:17:20 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:17:20 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:17:20 user nova-compute[72019]:   </cpu>
Apr 14 13:17:20 user nova-compute[72019]:   <devices>
Apr 14 13:17:20 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:17:20 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:17:20 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.rescue"/>
Apr 14 13:17:20 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:17:20 user nova-compute[72019]:     </disk>
Apr 14 13:17:20 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:17:20 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:17:20 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk"/>
Apr 14 13:17:20 user nova-compute[72019]:       <target dev="vdb" bus="virtio"/>
Apr 14 13:17:20 user nova-compute[72019]:     </disk>
Apr 14 13:17:20 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:17:20 user nova-compute[72019]:       <mac address="fa:16:3e:4e:26:54"/>
Apr 14 13:17:20 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:17:20 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:17:20 user nova-compute[72019]:       <target dev="tapf15f52ef-e4"/>
Apr 14 13:17:20 user nova-compute[72019]:     </interface>
Apr 14 13:17:20 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:17:20 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/console.log" append="off"/>
Apr 14 13:17:20 user nova-compute[72019]:     </serial>
Apr 14 13:17:20 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:17:20 user nova-compute[72019]:     <video>
Apr 14 13:17:20 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:17:20 user nova-compute[72019]:     </video>
Apr 14 13:17:20 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:17:20 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:17:20 user nova-compute[72019]:     </rng>
Apr 14 13:17:20 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:17:20 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:17:20 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:17:20 user nova-compute[72019]:     </memballoon>
Apr 14 13:17:20 user nova-compute[72019]:   </devices>
Apr 14 13:17:20 user nova-compute[72019]: </domain>
Apr 14 13:17:20 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:17:20 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Instance destroyed successfully.
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:17:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No VIF found with MAC fa:16:3e:4e:26:54, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:17:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:17:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:21 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:17:21 user nova-compute[72019]: INFO nova.compute.claims [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Claim successful on node user
Apr 14 13:17:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG nova.compute.manager [req-48a49593-2e97-4e8a-aa49-2c1c674c6e4a req-97e13dc8-89e6-46e9-aece-ad70b9bc4d06 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-48a49593-2e97-4e8a-aa49-2c1c674c6e4a req-97e13dc8-89e6-46e9-aece-ad70b9bc4d06 service nova] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-48a49593-2e97-4e8a-aa49-2c1c674c6e4a req-97e13dc8-89e6-46e9-aece-ad70b9bc4d06 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-48a49593-2e97-4e8a-aa49-2c1c674c6e4a req-97e13dc8-89e6-46e9-aece-ad70b9bc4d06 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG nova.compute.manager [req-48a49593-2e97-4e8a-aa49-2c1c674c6e4a req-97e13dc8-89e6-46e9-aece-ad70b9bc4d06 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] No waiting events found dispatching network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:22 user nova-compute[72019]: WARNING nova.compute.manager [req-48a49593-2e97-4e8a-aa49-2c1c674c6e4a req-97e13dc8-89e6-46e9-aece-ad70b9bc4d06 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received unexpected event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance with vm_state active and task_state rescuing.
Apr 14 13:17:22 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG nova.network.neutron [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:17:22 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:17:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG nova.policy [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:17:22 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Creating image(s)
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "/opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "/opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.148s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.157s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk 1073741824" returned: 0 in 0.061s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.185s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG nova.network.neutron [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Successfully created port: 25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Cannot resize image /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG nova.objects.instance [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'migration_context' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Ensure instance console log exists: /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG nova.network.neutron [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Successfully updated port: 25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquired lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG nova.network.neutron [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-8f3609c2-34fa-4bdd-9c7d-73cfe65865b6 req-93b7d9a8-c1ee-4889-92fa-34f2602560f2 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-changed-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-8f3609c2-34fa-4bdd-9c7d-73cfe65865b6 req-93b7d9a8-c1ee-4889-92fa-34f2602560f2 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Refreshing instance network info cache due to event network-changed-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:17:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8f3609c2-34fa-4bdd-9c7d-73cfe65865b6 req-93b7d9a8-c1ee-4889-92fa-34f2602560f2 service nova] Acquiring lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] No waiting events found dispatching network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:24 user nova-compute[72019]: WARNING nova.compute.manager [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received unexpected event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance with vm_state active and task_state rescuing.
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] No waiting events found dispatching network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:24 user nova-compute[72019]: WARNING nova.compute.manager [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received unexpected event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance with vm_state active and task_state rescuing.
Apr 14 13:17:24 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating instance_info_cache with network_info: [{"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Releasing lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance network_info: |[{"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8f3609c2-34fa-4bdd-9c7d-73cfe65865b6 req-93b7d9a8-c1ee-4889-92fa-34f2602560f2 service nova] Acquired lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-8f3609c2-34fa-4bdd-9c7d-73cfe65865b6 req-93b7d9a8-c1ee-4889-92fa-34f2602560f2 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Refreshing network info cache for port 25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Start _get_guest_xml network_info=[{"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:17:24 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:17:24 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1306609806',display_name='tempest-ServerActionsTestJSON-server-1306609806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1306609806',id=21,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-n0fqg6y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:17:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=6e646c88-579e-4ea1-b987-da1c7194a064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.objects.instance [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478244.5539484, 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:17:24 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] VM Resumed (Lifecycle Event)
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:17:24 user nova-compute[72019]:   <uuid>6e646c88-579e-4ea1-b987-da1c7194a064</uuid>
Apr 14 13:17:24 user nova-compute[72019]:   <name>instance-00000015</name>
Apr 14 13:17:24 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:17:24 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:17:24 user nova-compute[72019]:   <metadata>
Apr 14 13:17:24 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:17:24 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:17:24 user nova-compute[72019]:       <nova:name>tempest-ServerActionsTestJSON-server-1306609806</nova:name>
Apr 14 13:17:24 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:17:24</nova:creationTime>
Apr 14 13:17:24 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:17:24 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:17:24 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:17:24 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:17:24 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:17:24 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:17:24 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:17:24 user nova-compute[72019]:       <nova:owner>
Apr 14 13:17:24 user nova-compute[72019]:         <nova:user uuid="9169729edbd04fd5a74d2cffd0aa437f">tempest-ServerActionsTestJSON-1929049437-project-member</nova:user>
Apr 14 13:17:24 user nova-compute[72019]:         <nova:project uuid="4b197f1df57f4dee9757639cf861eb97">tempest-ServerActionsTestJSON-1929049437</nova:project>
Apr 14 13:17:24 user nova-compute[72019]:       </nova:owner>
Apr 14 13:17:24 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:17:24 user nova-compute[72019]:       <nova:ports>
Apr 14 13:17:24 user nova-compute[72019]:         <nova:port uuid="25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7">
Apr 14 13:17:24 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 13:17:24 user nova-compute[72019]:         </nova:port>
Apr 14 13:17:24 user nova-compute[72019]:       </nova:ports>
Apr 14 13:17:24 user nova-compute[72019]:     </nova:instance>
Apr 14 13:17:24 user nova-compute[72019]:   </metadata>
Apr 14 13:17:24 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:17:24 user nova-compute[72019]:     <system>
Apr 14 13:17:24 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:17:24 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:17:24 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:17:24 user nova-compute[72019]:       <entry name="serial">6e646c88-579e-4ea1-b987-da1c7194a064</entry>
Apr 14 13:17:24 user nova-compute[72019]:       <entry name="uuid">6e646c88-579e-4ea1-b987-da1c7194a064</entry>
Apr 14 13:17:24 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:17:24 user nova-compute[72019]:     </system>
Apr 14 13:17:24 user nova-compute[72019]:   </sysinfo>
Apr 14 13:17:24 user nova-compute[72019]:   <os>
Apr 14 13:17:24 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:17:24 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:17:24 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:17:24 user nova-compute[72019]:   </os>
Apr 14 13:17:24 user nova-compute[72019]:   <features>
Apr 14 13:17:24 user nova-compute[72019]:     <acpi/>
Apr 14 13:17:24 user nova-compute[72019]:     <apic/>
Apr 14 13:17:24 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:17:24 user nova-compute[72019]:   </features>
Apr 14 13:17:24 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:17:24 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:17:24 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:17:24 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:17:24 user nova-compute[72019]:   </clock>
Apr 14 13:17:24 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:17:24 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:17:24 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:17:24 user nova-compute[72019]:   </cpu>
Apr 14 13:17:24 user nova-compute[72019]:   <devices>
Apr 14 13:17:24 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:17:24 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:17:24 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk"/>
Apr 14 13:17:24 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:17:24 user nova-compute[72019]:     </disk>
Apr 14 13:17:24 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:17:24 user nova-compute[72019]:       <mac address="fa:16:3e:28:28:75"/>
Apr 14 13:17:24 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:17:24 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:17:24 user nova-compute[72019]:       <target dev="tap25b21f1a-fb"/>
Apr 14 13:17:24 user nova-compute[72019]:     </interface>
Apr 14 13:17:24 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:17:24 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/console.log" append="off"/>
Apr 14 13:17:24 user nova-compute[72019]:     </serial>
Apr 14 13:17:24 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:17:24 user nova-compute[72019]:     <video>
Apr 14 13:17:24 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:17:24 user nova-compute[72019]:     </video>
Apr 14 13:17:24 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:17:24 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:17:24 user nova-compute[72019]:     </rng>
Apr 14 13:17:24 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:17:24 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:17:24 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:17:24 user nova-compute[72019]:     </memballoon>
Apr 14 13:17:24 user nova-compute[72019]:   </devices>
Apr 14 13:17:24 user nova-compute[72019]: </domain>
Apr 14 13:17:24 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1306609806',display_name='tempest-ServerActionsTestJSON-server-1306609806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1306609806',id=21,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-n0fqg6y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:17:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=6e646c88-579e-4ea1-b987-da1c7194a064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG os_vif [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-c34d24a3-a632-4f05-b6fb-dc3562dc93d6" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-c34d24a3-a632-4f05-b6fb-dc3562dc93d6" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25b21f1a-fb, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25b21f1a-fb, col_values=(('external_ids', {'iface-id': '25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:28:75', 'vm-uuid': '6e646c88-579e-4ea1-b987-da1c7194a064'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:17:24 user nova-compute[72019]: INFO os_vif [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb')
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:17:24 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478244.5559444, 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:17:24 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] VM Started (Lifecycle Event)
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:17:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No VIF found with MAC fa:16:3e:28:28:75, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:17:25 user nova-compute[72019]: DEBUG nova.network.neutron [req-8f3609c2-34fa-4bdd-9c7d-73cfe65865b6 req-93b7d9a8-c1ee-4889-92fa-34f2602560f2 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updated VIF entry in instance network info cache for port 25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:17:25 user nova-compute[72019]: DEBUG nova.network.neutron [req-8f3609c2-34fa-4bdd-9c7d-73cfe65865b6 req-93b7d9a8-c1ee-4889-92fa-34f2602560f2 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating instance_info_cache with network_info: [{"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:17:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8f3609c2-34fa-4bdd-9c7d-73cfe65865b6 req-93b7d9a8-c1ee-4889-92fa-34f2602560f2 service nova] Releasing lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:17:25 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Updating instance_info_cache with network_info: [{"id": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "address": "fa:16:3e:52:d9:41", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab05b1-9e", "ovs_interfaceid": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-c34d24a3-a632-4f05-b6fb-dc3562dc93d6" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-1d76499e-46f2-4aa8-beb4-1dbaa61b3411 req-5f773448-b511-403f-943f-19daf9b3b4a2 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1d76499e-46f2-4aa8-beb4-1dbaa61b3411 req-5f773448-b511-403f-943f-19daf9b3b4a2 service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1d76499e-46f2-4aa8-beb4-1dbaa61b3411 req-5f773448-b511-403f-943f-19daf9b3b4a2 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1d76499e-46f2-4aa8-beb4-1dbaa61b3411 req-5f773448-b511-403f-943f-19daf9b3b4a2 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-1d76499e-46f2-4aa8-beb4-1dbaa61b3411 req-5f773448-b511-403f-943f-19daf9b3b4a2 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:26 user nova-compute[72019]: WARNING nova.compute.manager [req-1d76499e-46f2-4aa8-beb4-1dbaa61b3411 req-5f773448-b511-403f-943f-19daf9b3b4a2 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state building and task_state spawning.
Apr 14 13:17:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:17:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-802a28c8-820c-4fb7-8ded-fd53fe147006 req-b2b65354-f744-45e5-a62c-fa29fd26f8fb service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-802a28c8-820c-4fb7-8ded-fd53fe147006 req-b2b65354-f744-45e5-a62c-fa29fd26f8fb service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-802a28c8-820c-4fb7-8ded-fd53fe147006 req-b2b65354-f744-45e5-a62c-fa29fd26f8fb service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-802a28c8-820c-4fb7-8ded-fd53fe147006 req-b2b65354-f744-45e5-a62c-fa29fd26f8fb service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-802a28c8-820c-4fb7-8ded-fd53fe147006 req-b2b65354-f744-45e5-a62c-fa29fd26f8fb service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:28 user nova-compute[72019]: WARNING nova.compute.manager [req-802a28c8-820c-4fb7-8ded-fd53fe147006 req-b2b65354-f744-45e5-a62c-fa29fd26f8fb service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state building and task_state spawning.
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478248.4950705, 6e646c88-579e-4ea1-b987-da1c7194a064 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:17:28 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] VM Resumed (Lifecycle Event)
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:17:28 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance spawned successfully.
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:28 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478248.4971702, 6e646c88-579e-4ea1-b987-da1c7194a064 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:17:28 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] VM Started (Lifecycle Event)
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:28 user nova-compute[72019]: INFO nova.compute.manager [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Took 6.15 seconds to spawn the instance on the hypervisor.
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:17:28 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:28 user nova-compute[72019]: INFO nova.compute.manager [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Took 7.23 seconds to build instance.
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.363s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-0ef099bb-c3ad-41eb-aa2b-a3f51183d7ea req-caacaf47-b721-4d29-904b-10146f1f2730 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-changed-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-0ef099bb-c3ad-41eb-aa2b-a3f51183d7ea req-caacaf47-b721-4d29-904b-10146f1f2730 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Refreshing instance network info cache due to event network-changed-965f15ad-1141-41f1-b9f3-41097bb21b5e. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0ef099bb-c3ad-41eb-aa2b-a3f51183d7ea req-caacaf47-b721-4d29-904b-10146f1f2730 service nova] Acquiring lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0ef099bb-c3ad-41eb-aa2b-a3f51183d7ea req-caacaf47-b721-4d29-904b-10146f1f2730 service nova] Acquired lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG nova.network.neutron [req-0ef099bb-c3ad-41eb-aa2b-a3f51183d7ea req-caacaf47-b721-4d29-904b-10146f1f2730 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Refreshing network info cache for port 965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:29 user nova-compute[72019]: INFO nova.compute.manager [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Terminating instance
Apr 14 13:17:29 user nova-compute[72019]: DEBUG nova.compute.manager [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:29 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:30 user nova-compute[72019]: INFO nova.compute.manager [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Detaching volume 49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:17:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:30 user nova-compute[72019]: INFO nova.virt.block_device [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Attempting to driver detach volume 49056810-6abe-48de-b4bd-71d9f5d45096 from mountpoint /dev/vdb
Apr 14 13:17:30 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Attempting to detach device vdb from instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:17:30 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:17:30 user nova-compute[72019]:   <source dev="/dev/sdh"/>
Apr 14 13:17:30 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:17:30 user nova-compute[72019]:   <serial>49056810-6abe-48de-b4bd-71d9f5d45096</serial>
Apr 14 13:17:30 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:17:30 user nova-compute[72019]: </disk>
Apr 14 13:17:30 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:17:30 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Successfully detached device vdb from instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 from the persistent domain config.
Apr 14 13:17:30 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:17:30 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:17:30 user nova-compute[72019]:   <source dev="/dev/sdh"/>
Apr 14 13:17:30 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:17:30 user nova-compute[72019]:   <serial>49056810-6abe-48de-b4bd-71d9f5d45096</serial>
Apr 14 13:17:30 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:17:30 user nova-compute[72019]: </disk>
Apr 14 13:17:30 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:30 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Instance destroyed successfully.
Apr 14 13:17:30 user nova-compute[72019]: DEBUG nova.objects.instance [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lazy-loading 'resources' on Instance uuid bb40ccf2-2c37-46ff-be3d-242dc69d0655 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:15:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1313042541',display_name='tempest-VolumesActionsTest-instance-1313042541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1313042541',id=16,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:15:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1c7d361867b4265bd4e1d13e9e66bc4',ramdisk_id='',reservation_id='r-0i6him55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2125520108',owner_user_name='tempest-VolumesActionsTest-2125520108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:15:47Z,user_data=None,user_id='1c4166b50a7c49158acc8684eaee6041',uuid=bb40ccf2-2c37-46ff-be3d-242dc69d0655,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "address": "fa:16:3e:d8:b4:9a", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb2e08e-e7", "ovs_interfaceid": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Converting VIF {"id": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "address": "fa:16:3e:d8:b4:9a", "network": {"id": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1736941466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e1c7d361867b4265bd4e1d13e9e66bc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb2e08e-e7", "ovs_interfaceid": "8cb2e08e-e795-4c9f-ac2c-e249116ef595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb2e08e-e795-4c9f-ac2c-e249116ef595,network=Network(c6dfe7b8-e16e-4c31-93b7-9e358f72de7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb2e08e-e7') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG os_vif [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb2e08e-e795-4c9f-ac2c-e249116ef595,network=Network(c6dfe7b8-e16e-4c31-93b7-9e358f72de7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb2e08e-e7') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cb2e08e-e7, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:17:30 user nova-compute[72019]: INFO os_vif [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb2e08e-e795-4c9f-ac2c-e249116ef595,network=Network(c6dfe7b8-e16e-4c31-93b7-9e358f72de7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb2e08e-e7')
Apr 14 13:17:30 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Deleting instance files /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655_del
Apr 14 13:17:30 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Deletion of /opt/stack/data/nova/instances/bb40ccf2-2c37-46ff-be3d-242dc69d0655_del complete
Apr 14 13:17:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG nova.network.neutron [req-0ef099bb-c3ad-41eb-aa2b-a3f51183d7ea req-caacaf47-b721-4d29-904b-10146f1f2730 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Updated VIF entry in instance network info cache for port 965f15ad-1141-41f1-b9f3-41097bb21b5e. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:17:30 user nova-compute[72019]: DEBUG nova.network.neutron [req-0ef099bb-c3ad-41eb-aa2b-a3f51183d7ea req-caacaf47-b721-4d29-904b-10146f1f2730 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Updating instance_info_cache with network_info: [{"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:17:31 user nova-compute[72019]: INFO nova.compute.manager [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Took 1.13 seconds to destroy the instance on the hypervisor.
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0ef099bb-c3ad-41eb-aa2b-a3f51183d7ea req-caacaf47-b721-4d29-904b-10146f1f2730 service nova] Releasing lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478251.1604743, c34d24a3-a632-4f05-b6fb-dc3562dc93d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:17:31 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Successfully detached device vdb from instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 from the live domain config.
Apr 14 13:17:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEcyLTCw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:17:31 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2e2874-d3f0-467a-953c-005a3c02bea5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:17:31 user nova-compute[72019]: No targets found.
Apr 14 13:17:31 user nova-compute[72019]: iSNS:
Apr 14 13:17:31 user nova-compute[72019]: No targets found.
Apr 14 13:17:31 user nova-compute[72019]: STATIC:
Apr 14 13:17:31 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096
Apr 14 13:17:31 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:17:31 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:17:31 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:17:31 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:17:31 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:17:31 user nova-compute[72019]: FIRMWARE:
Apr 14 13:17:31 user nova-compute[72019]: No targets found.
Apr 14 13:17:31 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:17:31 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:17:31 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a22bf1e-4ac2-4e2d-87e8-bbf0fc91d988]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb6295a-2393-4606-bbab-2ad210ae212c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:17:31 user nova-compute[72019]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:17:31 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 (non-flash)
Apr 14 13:17:31 user nova-compute[72019]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:17:31 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7490114040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096'): ({'sdh'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Removing single pathed devices sdh {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:17:31 user nova-compute[72019]: INFO nova.compute.manager [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] instance snapshotting
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0ebd96-062e-4819-a75a-8dc722991a8d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.043s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1053692b-97ba-4e5d-b0a5-05f58cf6e9b0]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flushing IO for device /dev/sdh {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Beginning live snapshot process
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccb19a3-21d0-4e41-bcf1-a832b6b0246b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.057s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48dc522-de8a-45da-8106-3ff5271e2ba3]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] SCSI volumes sdh have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a58a21-f87d-4377-bf37-250ed42f8641]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[360b6b24-7ff6-439b-b250-cdc84659334d]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096, portal: 172.16.0.220,3260]
Apr 14 13:17:31 user nova-compute[72019]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096, portal: 172.16.0.220,3260] successful.
Apr 14 13:17:31 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49056810-6abe-48de-b4bd-71d9f5d45096 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0783a92f-28ea-4083-9738-f3bd367f2ee0]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] <== disconnect_volume: return (450ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json -f qcow2 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG nova.compute.manager [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Received event network-vif-unplugged-8cb2e08e-e795-4c9f-ac2c-e249116ef595 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] Acquiring lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] Lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] Lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG nova.compute.manager [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] No waiting events found dispatching network-vif-unplugged-8cb2e08e-e795-4c9f-ac2c-e249116ef595 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG nova.compute.manager [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Received event network-vif-unplugged-8cb2e08e-e795-4c9f-ac2c-e249116ef595 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG nova.compute.manager [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Received event network-vif-plugged-8cb2e08e-e795-4c9f-ac2c-e249116ef595 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] Acquiring lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] Lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] Lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG nova.compute.manager [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] No waiting events found dispatching network-vif-plugged-8cb2e08e-e795-4c9f-ac2c-e249116ef595 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:31 user nova-compute[72019]: WARNING nova.compute.manager [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Received unexpected event network-vif-plugged-8cb2e08e-e795-4c9f-ac2c-e249116ef595 for instance with vm_state active and task_state deleting.
Apr 14 13:17:31 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:17:31 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Took 0.85 seconds to deallocate network for instance.
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json -f qcow2" returned: 0 in 0.225s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json -f qcow2 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:32 user nova-compute[72019]: DEBUG nova.objects.instance [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'flavor' on Instance uuid c34d24a3-a632-4f05-b6fb-dc3562dc93d6 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json -f qcow2" returned: 0 in 0.822s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:32 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:17:32 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:17:32 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7327MB free_disk=26.412269592285156GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:17:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.815s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.175s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2ey2ulum/fd9eb78ec8c745359970e0ce9a87a7bb.delta 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2ey2ulum/fd9eb78ec8c745359970e0ce9a87a7bb.delta 1073741824" returned: 0 in 0.057s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:33 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.344s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.439s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:33 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Deleted allocations for instance bb40ccf2-2c37-46ff-be3d-242dc69d0655
Apr 14 13:17:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "bb40ccf2-2c37-46ff-be3d-242dc69d0655" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.619s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance c74c3463-6701-4150-9096-1775785e8e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 8b5d7047-087e-44f4-b977-12c719f5a302 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-ac251617-6788-41ac-971a-1c6b9899ae52 req-0aa66beb-e87b-40f7-b25d-72dcaf3c9fea service nova] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Received event network-vif-deleted-8cb2e08e-e795-4c9f-ac2c-e249116ef595 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:17:33 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:17:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:17:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.696s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:17:34 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 13:17:34 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:17:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2ey2ulum/fd9eb78ec8c745359970e0ce9a87a7bb.delta /opt/stack/data/nova/instances/snapshots/tmp2ey2ulum/fd9eb78ec8c745359970e0ce9a87a7bb {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2ey2ulum/fd9eb78ec8c745359970e0ce9a87a7bb.delta /opt/stack/data/nova/instances/snapshots/tmp2ey2ulum/fd9eb78ec8c745359970e0ce9a87a7bb" returned: 0 in 0.363s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:34 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Snapshot extracted, beginning image upload
Apr 14 13:17:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:38 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Snapshot image upload complete
Apr 14 13:17:38 user nova-compute[72019]: INFO nova.compute.manager [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Took 6.66 seconds to snapshot the instance on the hypervisor.
Apr 14 13:17:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:40 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:17:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:40 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:17:40 user nova-compute[72019]: INFO nova.compute.claims [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Claim successful on node user
Apr 14 13:17:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG nova.network.neutron [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:17:41 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:17:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG nova.policy [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2272cf2bf2f148e59dd600921894bb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c008548ed42bbaffac5876989b3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:17:41 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Creating image(s)
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "/opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "/opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk 1073741824" returned: 0 in 0.053s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:17:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:42 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Cannot resize image /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:17:42 user nova-compute[72019]: DEBUG nova.objects.instance [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lazy-loading 'migration_context' on Instance uuid 7c9e5ef7-70a6-449b-bc05-ff1d80465754 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:42 user nova-compute[72019]: DEBUG nova.network.neutron [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Successfully created port: 697153ca-2b37-46af-a0d3-7624fea31022 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:17:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:17:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Ensure instance console log exists: /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:17:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:42 user nova-compute[72019]: DEBUG nova.network.neutron [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Successfully updated port: 697153ca-2b37-46af-a0d3-7624fea31022 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:17:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "refresh_cache-7c9e5ef7-70a6-449b-bc05-ff1d80465754" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:17:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquired lock "refresh_cache-7c9e5ef7-70a6-449b-bc05-ff1d80465754" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:17:42 user nova-compute[72019]: DEBUG nova.network.neutron [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-530a7878-2cac-41ae-9144-6396586cfd6d req-9fc7494e-7754-47a9-a05a-e1b0c3d94de4 service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Received event network-changed-697153ca-2b37-46af-a0d3-7624fea31022 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-530a7878-2cac-41ae-9144-6396586cfd6d req-9fc7494e-7754-47a9-a05a-e1b0c3d94de4 service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Refreshing instance network info cache due to event network-changed-697153ca-2b37-46af-a0d3-7624fea31022. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-530a7878-2cac-41ae-9144-6396586cfd6d req-9fc7494e-7754-47a9-a05a-e1b0c3d94de4 service nova] Acquiring lock "refresh_cache-7c9e5ef7-70a6-449b-bc05-ff1d80465754" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.network.neutron [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.network.neutron [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Updating instance_info_cache with network_info: [{"id": "697153ca-2b37-46af-a0d3-7624fea31022", "address": "fa:16:3e:ef:01:cc", "network": {"id": "be533313-1783-4791-b33f-7b13e2201700", "bridge": "br-int", "label": "tempest-VolumesActionsTest-111134217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e50c008548ed42bbaffac5876989b3a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697153ca-2b", "ovs_interfaceid": "697153ca-2b37-46af-a0d3-7624fea31022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Releasing lock "refresh_cache-7c9e5ef7-70a6-449b-bc05-ff1d80465754" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Instance network_info: |[{"id": "697153ca-2b37-46af-a0d3-7624fea31022", "address": "fa:16:3e:ef:01:cc", "network": {"id": "be533313-1783-4791-b33f-7b13e2201700", "bridge": "br-int", "label": "tempest-VolumesActionsTest-111134217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e50c008548ed42bbaffac5876989b3a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697153ca-2b", "ovs_interfaceid": "697153ca-2b37-46af-a0d3-7624fea31022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-530a7878-2cac-41ae-9144-6396586cfd6d req-9fc7494e-7754-47a9-a05a-e1b0c3d94de4 service nova] Acquired lock "refresh_cache-7c9e5ef7-70a6-449b-bc05-ff1d80465754" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.network.neutron [req-530a7878-2cac-41ae-9144-6396586cfd6d req-9fc7494e-7754-47a9-a05a-e1b0c3d94de4 service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Refreshing network info cache for port 697153ca-2b37-46af-a0d3-7624fea31022 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Start _get_guest_xml network_info=[{"id": "697153ca-2b37-46af-a0d3-7624fea31022", "address": "fa:16:3e:ef:01:cc", "network": {"id": "be533313-1783-4791-b33f-7b13e2201700", "bridge": "br-int", "label": "tempest-VolumesActionsTest-111134217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e50c008548ed42bbaffac5876989b3a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697153ca-2b", "ovs_interfaceid": "697153ca-2b37-46af-a0d3-7624fea31022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:17:43 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:17:43 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1701137510',display_name='tempest-VolumesActionsTest-instance-1701137510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1701137510',id=22,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50c008548ed42bbaffac5876989b3a0',ramdisk_id='',reservation_id='r-zwa006yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2460432',owner_user_name='tempest-VolumesActionsTest-2460432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:17:41Z,user_data=None,user_id='2272cf2bf2f148e59dd600921894bb65',uuid=7c9e5ef7-70a6-449b-bc05-ff1d80465754,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "697153ca-2b37-46af-a0d3-7624fea31022", "address": "fa:16:3e:ef:01:cc", "network": {"id": "be533313-1783-4791-b33f-7b13e2201700", "bridge": "br-int", "label": "tempest-VolumesActionsTest-111134217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e50c008548ed42bbaffac5876989b3a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697153ca-2b", "ovs_interfaceid": "697153ca-2b37-46af-a0d3-7624fea31022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Converting VIF {"id": "697153ca-2b37-46af-a0d3-7624fea31022", "address": "fa:16:3e:ef:01:cc", "network": {"id": "be533313-1783-4791-b33f-7b13e2201700", "bridge": "br-int", "label": "tempest-VolumesActionsTest-111134217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e50c008548ed42bbaffac5876989b3a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697153ca-2b", "ovs_interfaceid": "697153ca-2b37-46af-a0d3-7624fea31022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:01:cc,bridge_name='br-int',has_traffic_filtering=True,id=697153ca-2b37-46af-a0d3-7624fea31022,network=Network(be533313-1783-4791-b33f-7b13e2201700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697153ca-2b') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.objects.instance [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c9e5ef7-70a6-449b-bc05-ff1d80465754 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:17:43 user nova-compute[72019]:   <uuid>7c9e5ef7-70a6-449b-bc05-ff1d80465754</uuid>
Apr 14 13:17:43 user nova-compute[72019]:   <name>instance-00000016</name>
Apr 14 13:17:43 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:17:43 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:17:43 user nova-compute[72019]:   <metadata>
Apr 14 13:17:43 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:17:43 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:17:43 user nova-compute[72019]:       <nova:name>tempest-VolumesActionsTest-instance-1701137510</nova:name>
Apr 14 13:17:43 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:17:43</nova:creationTime>
Apr 14 13:17:43 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:17:43 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:17:43 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:17:43 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:17:43 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:17:43 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:17:43 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:17:43 user nova-compute[72019]:       <nova:owner>
Apr 14 13:17:43 user nova-compute[72019]:         <nova:user uuid="2272cf2bf2f148e59dd600921894bb65">tempest-VolumesActionsTest-2460432-project-member</nova:user>
Apr 14 13:17:43 user nova-compute[72019]:         <nova:project uuid="e50c008548ed42bbaffac5876989b3a0">tempest-VolumesActionsTest-2460432</nova:project>
Apr 14 13:17:43 user nova-compute[72019]:       </nova:owner>
Apr 14 13:17:43 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:17:43 user nova-compute[72019]:       <nova:ports>
Apr 14 13:17:43 user nova-compute[72019]:         <nova:port uuid="697153ca-2b37-46af-a0d3-7624fea31022">
Apr 14 13:17:43 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 13:17:43 user nova-compute[72019]:         </nova:port>
Apr 14 13:17:43 user nova-compute[72019]:       </nova:ports>
Apr 14 13:17:43 user nova-compute[72019]:     </nova:instance>
Apr 14 13:17:43 user nova-compute[72019]:   </metadata>
Apr 14 13:17:43 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:17:43 user nova-compute[72019]:     <system>
Apr 14 13:17:43 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:17:43 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:17:43 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:17:43 user nova-compute[72019]:       <entry name="serial">7c9e5ef7-70a6-449b-bc05-ff1d80465754</entry>
Apr 14 13:17:43 user nova-compute[72019]:       <entry name="uuid">7c9e5ef7-70a6-449b-bc05-ff1d80465754</entry>
Apr 14 13:17:43 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:17:43 user nova-compute[72019]:     </system>
Apr 14 13:17:43 user nova-compute[72019]:   </sysinfo>
Apr 14 13:17:43 user nova-compute[72019]:   <os>
Apr 14 13:17:43 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:17:43 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:17:43 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:17:43 user nova-compute[72019]:   </os>
Apr 14 13:17:43 user nova-compute[72019]:   <features>
Apr 14 13:17:43 user nova-compute[72019]:     <acpi/>
Apr 14 13:17:43 user nova-compute[72019]:     <apic/>
Apr 14 13:17:43 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:17:43 user nova-compute[72019]:   </features>
Apr 14 13:17:43 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:17:43 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:17:43 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:17:43 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:17:43 user nova-compute[72019]:   </clock>
Apr 14 13:17:43 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:17:43 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:17:43 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:17:43 user nova-compute[72019]:   </cpu>
Apr 14 13:17:43 user nova-compute[72019]:   <devices>
Apr 14 13:17:43 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:17:43 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:17:43 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk"/>
Apr 14 13:17:43 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:17:43 user nova-compute[72019]:     </disk>
Apr 14 13:17:43 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:17:43 user nova-compute[72019]:       <mac address="fa:16:3e:ef:01:cc"/>
Apr 14 13:17:43 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:17:43 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:17:43 user nova-compute[72019]:       <target dev="tap697153ca-2b"/>
Apr 14 13:17:43 user nova-compute[72019]:     </interface>
Apr 14 13:17:43 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:17:43 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/console.log" append="off"/>
Apr 14 13:17:43 user nova-compute[72019]:     </serial>
Apr 14 13:17:43 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:17:43 user nova-compute[72019]:     <video>
Apr 14 13:17:43 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:17:43 user nova-compute[72019]:     </video>
Apr 14 13:17:43 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:17:43 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:17:43 user nova-compute[72019]:     </rng>
Apr 14 13:17:43 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:17:43 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:17:43 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:17:43 user nova-compute[72019]:     </memballoon>
Apr 14 13:17:43 user nova-compute[72019]:   </devices>
Apr 14 13:17:43 user nova-compute[72019]: </domain>
Apr 14 13:17:43 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1701137510',display_name='tempest-VolumesActionsTest-instance-1701137510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1701137510',id=22,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50c008548ed42bbaffac5876989b3a0',ramdisk_id='',reservation_id='r-zwa006yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2460432',owner_user_name='tempest-VolumesActionsTest-2460432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:17:41Z,user_data=None,user_id='2272cf2bf2f148e59dd600921894bb65',uuid=7c9e5ef7-70a6-449b-bc05-ff1d80465754,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "697153ca-2b37-46af-a0d3-7624fea31022", "address": "fa:16:3e:ef:01:cc", "network": {"id": "be533313-1783-4791-b33f-7b13e2201700", "bridge": "br-int", "label": "tempest-VolumesActionsTest-111134217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e50c008548ed42bbaffac5876989b3a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697153ca-2b", "ovs_interfaceid": "697153ca-2b37-46af-a0d3-7624fea31022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Converting VIF {"id": "697153ca-2b37-46af-a0d3-7624fea31022", "address": "fa:16:3e:ef:01:cc", "network": {"id": "be533313-1783-4791-b33f-7b13e2201700", "bridge": "br-int", "label": "tempest-VolumesActionsTest-111134217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e50c008548ed42bbaffac5876989b3a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697153ca-2b", "ovs_interfaceid": "697153ca-2b37-46af-a0d3-7624fea31022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:01:cc,bridge_name='br-int',has_traffic_filtering=True,id=697153ca-2b37-46af-a0d3-7624fea31022,network=Network(be533313-1783-4791-b33f-7b13e2201700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697153ca-2b') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG os_vif [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:01:cc,bridge_name='br-int',has_traffic_filtering=True,id=697153ca-2b37-46af-a0d3-7624fea31022,network=Network(be533313-1783-4791-b33f-7b13e2201700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697153ca-2b') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap697153ca-2b, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap697153ca-2b, col_values=(('external_ids', {'iface-id': '697153ca-2b37-46af-a0d3-7624fea31022', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:01:cc', 'vm-uuid': '7c9e5ef7-70a6-449b-bc05-ff1d80465754'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:43 user nova-compute[72019]: INFO os_vif [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:01:cc,bridge_name='br-int',has_traffic_filtering=True,id=697153ca-2b37-46af-a0d3-7624fea31022,network=Network(be533313-1783-4791-b33f-7b13e2201700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697153ca-2b')
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:17:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] No VIF found with MAC fa:16:3e:ef:01:cc, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:17:44 user nova-compute[72019]: DEBUG nova.network.neutron [req-530a7878-2cac-41ae-9144-6396586cfd6d req-9fc7494e-7754-47a9-a05a-e1b0c3d94de4 service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Updated VIF entry in instance network info cache for port 697153ca-2b37-46af-a0d3-7624fea31022. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:17:44 user nova-compute[72019]: DEBUG nova.network.neutron [req-530a7878-2cac-41ae-9144-6396586cfd6d req-9fc7494e-7754-47a9-a05a-e1b0c3d94de4 service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Updating instance_info_cache with network_info: [{"id": "697153ca-2b37-46af-a0d3-7624fea31022", "address": "fa:16:3e:ef:01:cc", "network": {"id": "be533313-1783-4791-b33f-7b13e2201700", "bridge": "br-int", "label": "tempest-VolumesActionsTest-111134217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e50c008548ed42bbaffac5876989b3a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697153ca-2b", "ovs_interfaceid": "697153ca-2b37-46af-a0d3-7624fea31022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:17:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-530a7878-2cac-41ae-9144-6396586cfd6d req-9fc7494e-7754-47a9-a05a-e1b0c3d94de4 service nova] Releasing lock "refresh_cache-7c9e5ef7-70a6-449b-bc05-ff1d80465754" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:17:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:17:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:44 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:17:44 user nova-compute[72019]: INFO nova.compute.claims [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Claim successful on node user
Apr 14 13:17:44 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:17:44 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG nova.network.neutron [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:17:45 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:17:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG nova.policy [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:17:45 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Creating image(s)
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "/opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "/opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.245s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.155s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk 1073741824" returned: 0 in 0.057s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG nova.compute.manager [req-525c8318-4b64-41b0-93d9-a0489d99de9d req-6e692cfc-49cf-4235-8e49-3645a252ebc0 service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Received event network-vif-plugged-697153ca-2b37-46af-a0d3-7624fea31022 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-525c8318-4b64-41b0-93d9-a0489d99de9d req-6e692cfc-49cf-4235-8e49-3645a252ebc0 service nova] Acquiring lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-525c8318-4b64-41b0-93d9-a0489d99de9d req-6e692cfc-49cf-4235-8e49-3645a252ebc0 service nova] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-525c8318-4b64-41b0-93d9-a0489d99de9d req-6e692cfc-49cf-4235-8e49-3645a252ebc0 service nova] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG nova.compute.manager [req-525c8318-4b64-41b0-93d9-a0489d99de9d req-6e692cfc-49cf-4235-8e49-3645a252ebc0 service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] No waiting events found dispatching network-vif-plugged-697153ca-2b37-46af-a0d3-7624fea31022 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:45 user nova-compute[72019]: WARNING nova.compute.manager [req-525c8318-4b64-41b0-93d9-a0489d99de9d req-6e692cfc-49cf-4235-8e49-3645a252ebc0 service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Received unexpected event network-vif-plugged-697153ca-2b37-46af-a0d3-7624fea31022 for instance with vm_state building and task_state spawning.
Apr 14 13:17:45 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478250.7594125, bb40ccf2-2c37-46ff-be3d-242dc69d0655 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:17:45 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] VM Stopped (Lifecycle Event)
Apr 14 13:17:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-65b91e22-c1db-4bf1-802b-1c5871023d43 None None] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.156s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:17:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Cannot resize image /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG nova.objects.instance [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'migration_context' on Instance uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Ensure instance console log exists: /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG nova.network.neutron [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Successfully created port: 351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "8b5d7047-087e-44f4-b977-12c719f5a302" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "8b5d7047-087e-44f4-b977-12c719f5a302" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:46 user nova-compute[72019]: INFO nova.compute.manager [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Terminating instance
Apr 14 13:17:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Successfully updated port: 351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquired lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-4e0eaf64-37d8-4d16-a45e-7635a395370f req-034baded-2c77-4a18-8e35-873c0988eff3 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-changed-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-4e0eaf64-37d8-4d16-a45e-7635a395370f req-034baded-2c77-4a18-8e35-873c0988eff3 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Refreshing instance network info cache due to event network-changed-351008cc-2fb2-4fa8-997d-96ea40263d9d. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4e0eaf64-37d8-4d16-a45e-7635a395370f req-034baded-2c77-4a18-8e35-873c0988eff3 service nova] Acquiring lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Instance destroyed successfully.
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.objects.instance [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lazy-loading 'resources' on Instance uuid 8b5d7047-087e-44f4-b977-12c719f5a302 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:15:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-652713944',display_name='tempest-VolumesAdminNegativeTest-server-652713944',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-652713944',id=17,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9094bc9720194f02abdc6d0b081c7e32',ramdisk_id='',reservation_id='r-jiqs1cwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1303459042',owner_user_name='tempest-VolumesAdminNegativeTest-1303459042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:15:57Z,user_data=None,user_id='f1387c0adbe74072b52886ddc2af4182',uuid=8b5d7047-087e-44f4-b977-12c719f5a302,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "address": "fa:16:3e:72:48:35", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9a4ea0-41", "ovs_interfaceid": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Converting VIF {"id": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "address": "fa:16:3e:72:48:35", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9a4ea0-41", "ovs_interfaceid": "bc9a4ea0-414f-43d8-995a-edb489f1b810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:35,bridge_name='br-int',has_traffic_filtering=True,id=bc9a4ea0-414f-43d8-995a-edb489f1b810,network=Network(ac0fadd7-d406-42a9-84c3-72fcfa33dc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9a4ea0-41') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG os_vif [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:35,bridge_name='br-int',has_traffic_filtering=True,id=bc9a4ea0-414f-43d8-995a-edb489f1b810,network=Network(ac0fadd7-d406-42a9-84c3-72fcfa33dc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9a4ea0-41') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc9a4ea0-41, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:17:47 user nova-compute[72019]: INFO os_vif [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:35,bridge_name='br-int',has_traffic_filtering=True,id=bc9a4ea0-414f-43d8-995a-edb489f1b810,network=Network(ac0fadd7-d406-42a9-84c3-72fcfa33dc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9a4ea0-41')
Apr 14 13:17:47 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Deleting instance files /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302_del
Apr 14 13:17:47 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Deletion of /opt/stack/data/nova/instances/8b5d7047-087e-44f4-b977-12c719f5a302_del complete
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: INFO nova.compute.manager [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updating instance_info_cache with network_info: [{"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Releasing lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Instance network_info: |[{"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4e0eaf64-37d8-4d16-a45e-7635a395370f req-034baded-2c77-4a18-8e35-873c0988eff3 service nova] Acquired lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.network.neutron [req-4e0eaf64-37d8-4d16-a45e-7635a395370f req-034baded-2c77-4a18-8e35-873c0988eff3 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Refreshing network info cache for port 351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Start _get_guest_xml network_info=[{"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:17:47 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:17:47 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2054124847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2054124847',id=23,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe8+NQxdd30Id654GBmcPwxA0JUpEg+Hy4COx6Fb893eVwtn8PELZv6pRPgbhjQTvkkY11PVtxzwFy1OaWZde1spOAQMgX1ADyyiK3GMyy+wZuqUsAbmtL2UTWG2YF/Rg==',key_name='tempest-keypair-1859762998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0fee50983a4e31b1689dc77b1c4db1',ramdisk_id='',reservation_id='r-bh3fqraz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1344633518',owner_user_name='tempest-AttachVolumeShelveTestJSON-1344633518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:17:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04370605aec40a0a53a080c1e8bf8a8',uuid=1a866f3f-b709-4286-8cef-8e3b35f26d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converting VIF {"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:74:1b,bridge_name='br-int',has_traffic_filtering=True,id=351008cc-2fb2-4fa8-997d-96ea40263d9d,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351008cc-2f') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.objects.instance [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478267.7155685, 7c9e5ef7-70a6-449b-bc05-ff1d80465754 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:17:47 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] VM Resumed (Lifecycle Event)
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:17:47 user nova-compute[72019]:   <uuid>1a866f3f-b709-4286-8cef-8e3b35f26d0b</uuid>
Apr 14 13:17:47 user nova-compute[72019]:   <name>instance-00000017</name>
Apr 14 13:17:47 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:17:47 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:17:47 user nova-compute[72019]:   <metadata>
Apr 14 13:17:47 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:17:47 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:17:47 user nova-compute[72019]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2054124847</nova:name>
Apr 14 13:17:47 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:17:47</nova:creationTime>
Apr 14 13:17:47 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:17:47 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:17:47 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:17:47 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:17:47 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:17:47 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:17:47 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:17:47 user nova-compute[72019]:       <nova:owner>
Apr 14 13:17:47 user nova-compute[72019]:         <nova:user uuid="f04370605aec40a0a53a080c1e8bf8a8">tempest-AttachVolumeShelveTestJSON-1344633518-project-member</nova:user>
Apr 14 13:17:47 user nova-compute[72019]:         <nova:project uuid="8f0fee50983a4e31b1689dc77b1c4db1">tempest-AttachVolumeShelveTestJSON-1344633518</nova:project>
Apr 14 13:17:47 user nova-compute[72019]:       </nova:owner>
Apr 14 13:17:47 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:17:47 user nova-compute[72019]:       <nova:ports>
Apr 14 13:17:47 user nova-compute[72019]:         <nova:port uuid="351008cc-2fb2-4fa8-997d-96ea40263d9d">
Apr 14 13:17:47 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 13:17:47 user nova-compute[72019]:         </nova:port>
Apr 14 13:17:47 user nova-compute[72019]:       </nova:ports>
Apr 14 13:17:47 user nova-compute[72019]:     </nova:instance>
Apr 14 13:17:47 user nova-compute[72019]:   </metadata>
Apr 14 13:17:47 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:17:47 user nova-compute[72019]:     <system>
Apr 14 13:17:47 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:17:47 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:17:47 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:17:47 user nova-compute[72019]:       <entry name="serial">1a866f3f-b709-4286-8cef-8e3b35f26d0b</entry>
Apr 14 13:17:47 user nova-compute[72019]:       <entry name="uuid">1a866f3f-b709-4286-8cef-8e3b35f26d0b</entry>
Apr 14 13:17:47 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:17:47 user nova-compute[72019]:     </system>
Apr 14 13:17:47 user nova-compute[72019]:   </sysinfo>
Apr 14 13:17:47 user nova-compute[72019]:   <os>
Apr 14 13:17:47 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:17:47 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:17:47 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:17:47 user nova-compute[72019]:   </os>
Apr 14 13:17:47 user nova-compute[72019]:   <features>
Apr 14 13:17:47 user nova-compute[72019]:     <acpi/>
Apr 14 13:17:47 user nova-compute[72019]:     <apic/>
Apr 14 13:17:47 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:17:47 user nova-compute[72019]:   </features>
Apr 14 13:17:47 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:17:47 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:17:47 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:17:47 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:17:47 user nova-compute[72019]:   </clock>
Apr 14 13:17:47 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:17:47 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:17:47 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:17:47 user nova-compute[72019]:   </cpu>
Apr 14 13:17:47 user nova-compute[72019]:   <devices>
Apr 14 13:17:47 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:17:47 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:17:47 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk"/>
Apr 14 13:17:47 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:17:47 user nova-compute[72019]:     </disk>
Apr 14 13:17:47 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:17:47 user nova-compute[72019]:       <mac address="fa:16:3e:45:74:1b"/>
Apr 14 13:17:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:17:47 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:17:47 user nova-compute[72019]:       <target dev="tap351008cc-2f"/>
Apr 14 13:17:47 user nova-compute[72019]:     </interface>
Apr 14 13:17:47 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:17:47 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/console.log" append="off"/>
Apr 14 13:17:47 user nova-compute[72019]:     </serial>
Apr 14 13:17:47 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:17:47 user nova-compute[72019]:     <video>
Apr 14 13:17:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:17:47 user nova-compute[72019]:     </video>
Apr 14 13:17:47 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:17:47 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:17:47 user nova-compute[72019]:     </rng>
Apr 14 13:17:47 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:17:47 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:17:47 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:17:47 user nova-compute[72019]:     </memballoon>
Apr 14 13:17:47 user nova-compute[72019]:   </devices>
Apr 14 13:17:47 user nova-compute[72019]: </domain>
Apr 14 13:17:47 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2054124847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2054124847',id=23,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe8+NQxdd30Id654GBmcPwxA0JUpEg+Hy4COx6Fb893eVwtn8PELZv6pRPgbhjQTvkkY11PVtxzwFy1OaWZde1spOAQMgX1ADyyiK3GMyy+wZuqUsAbmtL2UTWG2YF/Rg==',key_name='tempest-keypair-1859762998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0fee50983a4e31b1689dc77b1c4db1',ramdisk_id='',reservation_id='r-bh3fqraz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1344633518',owner_user_name='tempest-AttachVolumeShelveTestJSON-1344633518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:17:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04370605aec40a0a53a080c1e8bf8a8',uuid=1a866f3f-b709-4286-8cef-8e3b35f26d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converting VIF {"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:74:1b,bridge_name='br-int',has_traffic_filtering=True,id=351008cc-2fb2-4fa8-997d-96ea40263d9d,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351008cc-2f') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG os_vif [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:74:1b,bridge_name='br-int',has_traffic_filtering=True,id=351008cc-2fb2-4fa8-997d-96ea40263d9d,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351008cc-2f') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:47 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Instance spawned successfully.
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap351008cc-2f, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap351008cc-2f, col_values=(('external_ids', {'iface-id': '351008cc-2fb2-4fa8-997d-96ea40263d9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:74:1b', 'vm-uuid': '1a866f3f-b709-4286-8cef-8e3b35f26d0b'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:47 user nova-compute[72019]: INFO os_vif [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:74:1b,bridge_name='br-int',has_traffic_filtering=True,id=351008cc-2fb2-4fa8-997d-96ea40263d9d,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351008cc-2f')
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:47 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478267.7314565, 7c9e5ef7-70a6-449b-bc05-ff1d80465754 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:17:47 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] VM Started (Lifecycle Event)
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Received event network-vif-plugged-697153ca-2b37-46af-a0d3-7624fea31022 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Acquiring lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] No waiting events found dispatching network-vif-plugged-697153ca-2b37-46af-a0d3-7624fea31022 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:47 user nova-compute[72019]: WARNING nova.compute.manager [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Received unexpected event network-vif-plugged-697153ca-2b37-46af-a0d3-7624fea31022 for instance with vm_state building and task_state spawning.
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received event network-vif-unplugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Acquiring lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] No waiting events found dispatching network-vif-unplugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received event network-vif-unplugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received event network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Acquiring lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] No waiting events found dispatching network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:47 user nova-compute[72019]: WARNING nova.compute.manager [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received unexpected event network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance with vm_state active and task_state deleting.
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received event network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Acquiring lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] No waiting events found dispatching network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:47 user nova-compute[72019]: WARNING nova.compute.manager [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received unexpected event network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance with vm_state active and task_state deleting.
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] No VIF found with MAC fa:16:3e:45:74:1b, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:17:47 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:17:47 user nova-compute[72019]: INFO nova.compute.manager [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Took 6.50 seconds to spawn the instance on the hypervisor.
Apr 14 13:17:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:48 user nova-compute[72019]: INFO nova.compute.manager [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Took 7.52 seconds to build instance.
Apr 14 13:17:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.628s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:48 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:17:48 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Took 1.42 seconds to deallocate network for instance.
Apr 14 13:17:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-4e0eaf64-37d8-4d16-a45e-7635a395370f req-034baded-2c77-4a18-8e35-873c0988eff3 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updated VIF entry in instance network info cache for port 351008cc-2fb2-4fa8-997d-96ea40263d9d. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:17:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-4e0eaf64-37d8-4d16-a45e-7635a395370f req-034baded-2c77-4a18-8e35-873c0988eff3 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updating instance_info_cache with network_info: [{"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4e0eaf64-37d8-4d16-a45e-7635a395370f req-034baded-2c77-4a18-8e35-873c0988eff3 service nova] Releasing lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-36ac1acb-4631-4a2a-8d08-949b0bcfaf7a req-a3d83371-94d4-4877-baba-d7fab61f7d1e service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received event network-vif-deleted-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:49 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Deleted allocations for instance 8b5d7047-087e-44f4-b977-12c719f5a302
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "8b5d7047-087e-44f4-b977-12c719f5a302" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.095s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-576b2ad2-edd6-4beb-a6e6-0ddd7672e2c4 req-7aeb2ce2-5283-455f-9fe6-4dd3ee9421b8 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-576b2ad2-edd6-4beb-a6e6-0ddd7672e2c4 req-7aeb2ce2-5283-455f-9fe6-4dd3ee9421b8 service nova] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-576b2ad2-edd6-4beb-a6e6-0ddd7672e2c4 req-7aeb2ce2-5283-455f-9fe6-4dd3ee9421b8 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-576b2ad2-edd6-4beb-a6e6-0ddd7672e2c4 req-7aeb2ce2-5283-455f-9fe6-4dd3ee9421b8 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-576b2ad2-edd6-4beb-a6e6-0ddd7672e2c4 req-7aeb2ce2-5283-455f-9fe6-4dd3ee9421b8 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] No waiting events found dispatching network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:49 user nova-compute[72019]: WARNING nova.compute.manager [req-576b2ad2-edd6-4beb-a6e6-0ddd7672e2c4 req-7aeb2ce2-5283-455f-9fe6-4dd3ee9421b8 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received unexpected event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d for instance with vm_state building and task_state spawning.
Apr 14 13:17:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received event network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Acquiring lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] No waiting events found dispatching network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:49 user nova-compute[72019]: WARNING nova.compute.manager [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received unexpected event network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance with vm_state deleted and task_state None.
Apr 14 13:17:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received event network-vif-unplugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Acquiring lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] No waiting events found dispatching network-vif-unplugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:49 user nova-compute[72019]: WARNING nova.compute.manager [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received unexpected event network-vif-unplugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance with vm_state deleted and task_state None.
Apr 14 13:17:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received event network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Acquiring lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Lock "8b5d7047-087e-44f4-b977-12c719f5a302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] No waiting events found dispatching network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:49 user nova-compute[72019]: WARNING nova.compute.manager [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Received unexpected event network-vif-plugged-bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance with vm_state deleted and task_state None.
Apr 14 13:17:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478271.5525827, 1a866f3f-b709-4286-8cef-8e3b35f26d0b => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:17:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] VM Resumed (Lifecycle Event)
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:17:51 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Instance spawned successfully.
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:17:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478271.5543036, 1a866f3f-b709-4286-8cef-8e3b35f26d0b => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:17:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] VM Started (Lifecycle Event)
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:17:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:17:51 user nova-compute[72019]: INFO nova.compute.manager [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Took 6.41 seconds to spawn the instance on the hypervisor.
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-47cb07e9-6da7-4ac2-b14f-ad715e0faa0d req-8ad13751-e2a2-4d98-974e-88860cb92664 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-47cb07e9-6da7-4ac2-b14f-ad715e0faa0d req-8ad13751-e2a2-4d98-974e-88860cb92664 service nova] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-47cb07e9-6da7-4ac2-b14f-ad715e0faa0d req-8ad13751-e2a2-4d98-974e-88860cb92664 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-47cb07e9-6da7-4ac2-b14f-ad715e0faa0d req-8ad13751-e2a2-4d98-974e-88860cb92664 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-47cb07e9-6da7-4ac2-b14f-ad715e0faa0d req-8ad13751-e2a2-4d98-974e-88860cb92664 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] No waiting events found dispatching network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:17:51 user nova-compute[72019]: WARNING nova.compute.manager [req-47cb07e9-6da7-4ac2-b14f-ad715e0faa0d req-8ad13751-e2a2-4d98-974e-88860cb92664 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received unexpected event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d for instance with vm_state building and task_state spawning.
Apr 14 13:17:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:51 user nova-compute[72019]: INFO nova.compute.manager [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Took 7.24 seconds to build instance.
Apr 14 13:17:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.347s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:17:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:17:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:02 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478267.239778, 8b5d7047-087e-44f4-b977-12c719f5a302 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:18:02 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] VM Stopped (Lifecycle Event)
Apr 14 13:18:02 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cedd1b91-483c-4b8e-bd13-40a3747bf82c None None] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:18:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:12 user nova-compute[72019]: INFO nova.compute.manager [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Detaching volume 7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:18:12 user nova-compute[72019]: INFO nova.virt.block_device [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Attempting to driver detach volume 7f6a3c6d-43d9-4137-b0e1-699b36e9b999 from mountpoint /dev/vdb
Apr 14 13:18:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Attempting to detach device vdb from instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:18:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:18:12 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:18:12 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:18:12 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:18:12 user nova-compute[72019]:   <serial>7f6a3c6d-43d9-4137-b0e1-699b36e9b999</serial>
Apr 14 13:18:12 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 13:18:12 user nova-compute[72019]: </disk>
Apr 14 13:18:12 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:18:12 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Successfully detached device vdb from instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 from the persistent domain config.
Apr 14 13:18:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:18:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:18:12 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:18:12 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:18:12 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:18:12 user nova-compute[72019]:   <serial>7f6a3c6d-43d9-4137-b0e1-699b36e9b999</serial>
Apr 14 13:18:12 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 13:18:12 user nova-compute[72019]: </disk>
Apr 14 13:18:12 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:18:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478293.204256, 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:18:13 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Successfully detached device vdb from instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 from the live domain config.
Apr 14 13:18:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WydfNSbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:18:13 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4985b409-f629-489c-bfd9-ff9b9ea0386a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:18:13 user nova-compute[72019]: No targets found.
Apr 14 13:18:13 user nova-compute[72019]: iSNS:
Apr 14 13:18:13 user nova-compute[72019]: No targets found.
Apr 14 13:18:13 user nova-compute[72019]: STATIC:
Apr 14 13:18:13 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999
Apr 14 13:18:13 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:18:13 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:18:13 user nova-compute[72019]: FIRMWARE:
Apr 14 13:18:13 user nova-compute[72019]: No targets found.
Apr 14 13:18:13 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:18:13 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:18:13 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a73f46d-d775-422c-affe-a0049028e68a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9183313b-977f-4787-8c3f-447962f79ade]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:18:13 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 (non-flash)
Apr 14 13:18:13 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7490115630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999'): ({'sdb'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Removing single pathed devices sdb {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d470c861-18fe-4cf7-ae69-79c8515c1ad5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6b9ffa-40f3-4311-b34d-cc4e7703e4e3]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flushing IO for device /dev/sdb {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c13ed1-61c0-4a75-b261-02858aa0ca95]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a665986-9d2f-4a0a-a49e-7dd338dad929]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfb493e-7550-48a9-a2c9-d857ac22a8f6]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f1737e-9acb-4ba2-92e3-4d08351b7958]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260]
Apr 14 13:18:13 user nova-compute[72019]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999, portal: 172.16.0.220,3260] successful.
Apr 14 13:18:13 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f6a3c6d-43d9-4137-b0e1-699b36e9b999 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde9d8a4-40ab-448e-a53b-430484119f8b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] <== disconnect_volume: return (284ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:18:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:18:14 user nova-compute[72019]: DEBUG nova.objects.instance [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'flavor' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:18:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.801s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1bb8a927-c25f-4657-be5e-95c486d914a8 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1bb8a927-c25f-4657-be5e-95c486d914a8 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1bb8a927-c25f-4657-be5e-95c486d914a8 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:18:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1bb8a927-c25f-4657-be5e-95c486d914a8 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72019) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 13:18:14 user nova-compute[72019]: DEBUG nova.objects.instance [None req-1bb8a927-c25f-4657-be5e-95c486d914a8 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'flavor' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:18:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-026ce24c-d8e4-4454-8f40-717b5fa2c379 req-bbccb5b1-b4e6-4e4a-ad29-5d27b2846b26 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-vif-unplugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:18:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-026ce24c-d8e4-4454-8f40-717b5fa2c379 req-bbccb5b1-b4e6-4e4a-ad29-5d27b2846b26 service nova] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-026ce24c-d8e4-4454-8f40-717b5fa2c379 req-bbccb5b1-b4e6-4e4a-ad29-5d27b2846b26 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-026ce24c-d8e4-4454-8f40-717b5fa2c379 req-bbccb5b1-b4e6-4e4a-ad29-5d27b2846b26 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-026ce24c-d8e4-4454-8f40-717b5fa2c379 req-bbccb5b1-b4e6-4e4a-ad29-5d27b2846b26 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] No waiting events found dispatching network-vif-unplugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:18:15 user nova-compute[72019]: WARNING nova.compute.manager [req-026ce24c-d8e4-4454-8f40-717b5fa2c379 req-bbccb5b1-b4e6-4e4a-ad29-5d27b2846b26 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received unexpected event network-vif-unplugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance with vm_state active and task_state powering-off.
Apr 14 13:18:15 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Instance destroyed successfully.
Apr 14 13:18:15 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1bb8a927-c25f-4657-be5e-95c486d914a8 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:18:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1bb8a927-c25f-4657-be5e-95c486d914a8 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.852s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-f0b2d149-83a3-400e-a91d-8b2deed9b42b req-ba88b321-19bd-4afe-b6c1-65ac549615d8 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:18:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f0b2d149-83a3-400e-a91d-8b2deed9b42b req-ba88b321-19bd-4afe-b6c1-65ac549615d8 service nova] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f0b2d149-83a3-400e-a91d-8b2deed9b42b req-ba88b321-19bd-4afe-b6c1-65ac549615d8 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f0b2d149-83a3-400e-a91d-8b2deed9b42b req-ba88b321-19bd-4afe-b6c1-65ac549615d8 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-f0b2d149-83a3-400e-a91d-8b2deed9b42b req-ba88b321-19bd-4afe-b6c1-65ac549615d8 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] No waiting events found dispatching network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:18:17 user nova-compute[72019]: WARNING nova.compute.manager [req-f0b2d149-83a3-400e-a91d-8b2deed9b42b req-ba88b321-19bd-4afe-b6c1-65ac549615d8 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received unexpected event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance with vm_state stopped and task_state None.
Apr 14 13:18:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:20 user nova-compute[72019]: INFO nova.compute.manager [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Terminating instance
Apr 14 13:18:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Cleaning up deleted instances {{(pid=72019) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] There are 0 instances to clean {{(pid=72019) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72019) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG nova.compute.manager [req-f95da0c9-a36b-4c91-97d6-92d159a38e7e req-1a4c7652-741d-4831-94e6-e7de47fcf53b service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Received event network-vif-unplugged-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f95da0c9-a36b-4c91-97d6-92d159a38e7e req-1a4c7652-741d-4831-94e6-e7de47fcf53b service nova] Acquiring lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f95da0c9-a36b-4c91-97d6-92d159a38e7e req-1a4c7652-741d-4831-94e6-e7de47fcf53b service nova] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f95da0c9-a36b-4c91-97d6-92d159a38e7e req-1a4c7652-741d-4831-94e6-e7de47fcf53b service nova] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG nova.compute.manager [req-f95da0c9-a36b-4c91-97d6-92d159a38e7e req-1a4c7652-741d-4831-94e6-e7de47fcf53b service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] No waiting events found dispatching network-vif-unplugged-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:18:20 user nova-compute[72019]: DEBUG nova.compute.manager [req-f95da0c9-a36b-4c91-97d6-92d159a38e7e req-1a4c7652-741d-4831-94e6-e7de47fcf53b service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Received event network-vif-unplugged-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:18:21 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Instance destroyed successfully.
Apr 14 13:18:21 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'resources' on Instance uuid c34d24a3-a632-4f05-b6fb-dc3562dc93d6 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1885721133',display_name='tempest-AttachVolumeNegativeTest-server-1885721133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1885721133',id=5,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvwjWdhdL4p/vot8ehhliLkgSS+VX3N3hpUfRnGb4cxQCzMi+uh/nKjV34jvCMuz1AcDAnUhheia6vRHCdkI6iN4byvGQyKLEzU6N7m6Pa1bYwwTvypkLGfgAQNH5PIpA==',key_name='tempest-keypair-359510273',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6833a69217034c4d85ff10bf8aa2fa5c',ramdisk_id='',reservation_id='r-vt0mzk0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-893959880',owner_user_name='tempest-AttachVolumeNegativeTest-893959880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65812c6559684eddbdde33cd64ca1fba',uuid=c34d24a3-a632-4f05-b6fb-dc3562dc93d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "address": "fa:16:3e:52:d9:41", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab05b1-9e", "ovs_interfaceid": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converting VIF {"id": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "address": "fa:16:3e:52:d9:41", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab05b1-9e", "ovs_interfaceid": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:d9:41,bridge_name='br-int',has_traffic_filtering=True,id=5fab05b1-9e56-4f0d-84e0-22573efdb2c4,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fab05b1-9e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG os_vif [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:d9:41,bridge_name='br-int',has_traffic_filtering=True,id=5fab05b1-9e56-4f0d-84e0-22573efdb2c4,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fab05b1-9e') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fab05b1-9e, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:21 user nova-compute[72019]: INFO os_vif [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:d9:41,bridge_name='br-int',has_traffic_filtering=True,id=5fab05b1-9e56-4f0d-84e0-22573efdb2c4,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fab05b1-9e')
Apr 14 13:18:21 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Deleting instance files /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6_del
Apr 14 13:18:21 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Deletion of /opt/stack/data/nova/instances/c34d24a3-a632-4f05-b6fb-dc3562dc93d6_del complete
Apr 14 13:18:21 user nova-compute[72019]: INFO nova.compute.manager [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 13:18:21 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-c74c3463-6701-4150-9096-1775785e8e2a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-c74c3463-6701-4150-9096-1775785e8e2a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:18:21 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:18:22 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Took 1.22 seconds to deallocate network for instance.
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Updating instance_info_cache with network_info: [{"id": "81acf974-1e47-44a8-822c-3d47187e3ae5", "address": "fa:16:3e:86:67:71", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81acf974-1e", "ovs_interfaceid": "81acf974-1e47-44a8-822c-3d47187e3ae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-c74c3463-6701-4150-9096-1775785e8e2a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:18:22 user nova-compute[72019]: WARNING nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid cc4631eb-ae5b-4efa-9def-c0c45f56f40f {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid c34d24a3-a632-4f05-b6fb-dc3562dc93d6 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid c74c3463-6701-4150-9096-1775785e8e2a {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 847e2db8-10a7-416b-ae22-1c75b6d37817 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 978f6fc8-1080-4840-ab8a-e025efe4f906 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 2c051c82-e56a-4a50-a24b-23eb2136f3ee {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 7c9e5ef7-70a6-449b-bc05-ff1d80465754 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "c74c3463-6701-4150-9096-1775785e8e2a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "c74c3463-6701-4150-9096-1775785e8e2a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "847e2db8-10a7-416b-ae22-1c75b6d37817" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "978f6fc8-1080-4840-ab8a-e025efe4f906" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Refreshing inventories for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 13:18:22 user nova-compute[72019]: WARNING oslo_messaging._drivers.amqpdriver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Updating ProviderTree inventory for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Updating inventory in ProviderTree for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "c74c3463-6701-4150-9096-1775785e8e2a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Refreshing aggregate associations for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569, aggregates: None {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Refreshing trait associations for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [req-0b4acd9e-01a1-4830-8559-f8940d1b63d6 req-88e83c99-3c84-4715-8933-77c099c25835 service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Received event network-vif-plugged-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0b4acd9e-01a1-4830-8559-f8940d1b63d6 req-88e83c99-3c84-4715-8933-77c099c25835 service nova] Acquiring lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0b4acd9e-01a1-4830-8559-f8940d1b63d6 req-88e83c99-3c84-4715-8933-77c099c25835 service nova] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0b4acd9e-01a1-4830-8559-f8940d1b63d6 req-88e83c99-3c84-4715-8933-77c099c25835 service nova] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [req-0b4acd9e-01a1-4830-8559-f8940d1b63d6 req-88e83c99-3c84-4715-8933-77c099c25835 service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] No waiting events found dispatching network-vif-plugged-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:18:22 user nova-compute[72019]: WARNING nova.compute.manager [req-0b4acd9e-01a1-4830-8559-f8940d1b63d6 req-88e83c99-3c84-4715-8933-77c099c25835 service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Received unexpected event network-vif-plugged-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 for instance with vm_state deleted and task_state None.
Apr 14 13:18:22 user nova-compute[72019]: DEBUG nova.compute.manager [req-0b4acd9e-01a1-4830-8559-f8940d1b63d6 req-88e83c99-3c84-4715-8933-77c099c25835 service nova] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Received event network-vif-deleted-5fab05b1-9e56-4f0d-84e0-22573efdb2c4 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:18:23 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:18:23 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:18:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.594s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:23 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Deleted allocations for instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6
Apr 14 13:18:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.858s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.624s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "c34d24a3-a632-4f05-b6fb-dc3562dc93d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:23 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:18:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:23 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:18:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:28 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:18:28 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7394MB free_disk=26.351093292236328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance c74c3463-6701-4150-9096-1775785e8e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:18:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:30 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478295.6550884, 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:18:30 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] VM Stopped (Lifecycle Event)
Apr 14 13:18:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1066c73d-91e5-41aa-9e8e-4c5f0a20a213 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:18:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1066c73d-91e5-41aa-9e8e-4c5f0a20a213 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:18:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:18:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:33 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:18:33 user nova-compute[72019]: INFO nova.compute.claims [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Claim successful on node user
Apr 14 13:18:34 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:18:35 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:18:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.318s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:18:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:18:35 user nova-compute[72019]: DEBUG nova.network.neutron [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:18:35 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:18:36 user nova-compute[72019]: DEBUG nova.policy [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f713f95191542f6a23ee25669061b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b4e44c0b8945079de567503aab3a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:18:36 user nova-compute[72019]: DEBUG nova.compute.manager [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:18:36 user nova-compute[72019]: DEBUG nova.compute.manager [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:18:36 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478301.146955, c34d24a3-a632-4f05-b6fb-dc3562dc93d6 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:18:36 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] VM Stopped (Lifecycle Event)
Apr 14 13:18:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:36 user nova-compute[72019]: DEBUG nova.compute.manager [None req-738e44fa-63e5-4dcc-9f53-7b803425fe28 None None] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:18:36 user nova-compute[72019]: INFO nova.compute.manager [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] instance snapshotting
Apr 14 13:18:36 user nova-compute[72019]: DEBUG nova.compute.manager [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:18:36 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:18:36 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Creating image(s)
Apr 14 13:18:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "/opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "/opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:36 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Beginning live snapshot process
Apr 14 13:18:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.307s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json -f qcow2 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG nova.network.neutron [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Successfully created port: 5a229da1-537f-4dce-b171-39cf5b5cd438 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.187s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json -f qcow2 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/disk 1073741824" returned: 0 in 0.094s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json -f qcow2" returned: 0 in 0.162s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.172s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.209s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Cannot resize image /opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG nova.objects.instance [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lazy-loading 'migration_context' on Instance uuid 1e06aa11-247c-48ff-adc2-f321e6c72f1f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr3qtorsf/15329d907af54185854a8993d0f87f9b.delta 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Ensure instance console log exists: /opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr3qtorsf/15329d907af54185854a8993d0f87f9b.delta 1073741824" returned: 0 in 0.065s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:37 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 13:18:38 user nova-compute[72019]: DEBUG nova.network.neutron [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Successfully updated port: 5a229da1-537f-4dce-b171-39cf5b5cd438 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:18:38 user nova-compute[72019]: DEBUG nova.compute.manager [req-8f7c4914-66d9-458a-aed0-287c6fb54422 req-02aa269a-d844-49ba-990d-5632286552b6 service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Received event network-changed-5a229da1-537f-4dce-b171-39cf5b5cd438 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:18:38 user nova-compute[72019]: DEBUG nova.compute.manager [req-8f7c4914-66d9-458a-aed0-287c6fb54422 req-02aa269a-d844-49ba-990d-5632286552b6 service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Refreshing instance network info cache due to event network-changed-5a229da1-537f-4dce-b171-39cf5b5cd438. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:18:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8f7c4914-66d9-458a-aed0-287c6fb54422 req-02aa269a-d844-49ba-990d-5632286552b6 service nova] Acquiring lock "refresh_cache-1e06aa11-247c-48ff-adc2-f321e6c72f1f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:18:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8f7c4914-66d9-458a-aed0-287c6fb54422 req-02aa269a-d844-49ba-990d-5632286552b6 service nova] Acquired lock "refresh_cache-1e06aa11-247c-48ff-adc2-f321e6c72f1f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:18:38 user nova-compute[72019]: DEBUG nova.network.neutron [req-8f7c4914-66d9-458a-aed0-287c6fb54422 req-02aa269a-d844-49ba-990d-5632286552b6 service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Refreshing network info cache for port 5a229da1-537f-4dce-b171-39cf5b5cd438 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:18:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "refresh_cache-1e06aa11-247c-48ff-adc2-f321e6c72f1f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:18:38 user nova-compute[72019]: DEBUG nova.network.neutron [req-8f7c4914-66d9-458a-aed0-287c6fb54422 req-02aa269a-d844-49ba-990d-5632286552b6 service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:18:38 user nova-compute[72019]: DEBUG nova.network.neutron [req-8f7c4914-66d9-458a-aed0-287c6fb54422 req-02aa269a-d844-49ba-990d-5632286552b6 service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:18:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8f7c4914-66d9-458a-aed0-287c6fb54422 req-02aa269a-d844-49ba-990d-5632286552b6 service nova] Releasing lock "refresh_cache-1e06aa11-247c-48ff-adc2-f321e6c72f1f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:18:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquired lock "refresh_cache-1e06aa11-247c-48ff-adc2-f321e6c72f1f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:18:38 user nova-compute[72019]: DEBUG nova.network.neutron [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:18:38 user nova-compute[72019]: DEBUG nova.network.neutron [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.network.neutron [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Updating instance_info_cache with network_info: [{"id": "5a229da1-537f-4dce-b171-39cf5b5cd438", "address": "fa:16:3e:46:2c:69", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a229da1-53", "ovs_interfaceid": "5a229da1-537f-4dce-b171-39cf5b5cd438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Releasing lock "refresh_cache-1e06aa11-247c-48ff-adc2-f321e6c72f1f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Instance network_info: |[{"id": "5a229da1-537f-4dce-b171-39cf5b5cd438", "address": "fa:16:3e:46:2c:69", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a229da1-53", "ovs_interfaceid": "5a229da1-537f-4dce-b171-39cf5b5cd438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Start _get_guest_xml network_info=[{"id": "5a229da1-537f-4dce-b171-39cf5b5cd438", "address": "fa:16:3e:46:2c:69", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a229da1-53", "ovs_interfaceid": "5a229da1-537f-4dce-b171-39cf5b5cd438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:18:39 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:18:39 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1833341696',display_name='tempest-ServersNegativeTestJSON-server-1833341696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1833341696',id=24,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4b4e44c0b8945079de567503aab3a12',ramdisk_id='',reservation_id='r-3r68qu7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-548588779',owner_user_name='tempest-ServersNegativeTestJSON-548588779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:18:36Z,user_data=None,user_id='3f713f95191542f6a23ee25669061b27',uuid=1e06aa11-247c-48ff-adc2-f321e6c72f1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a229da1-537f-4dce-b171-39cf5b5cd438", "address": "fa:16:3e:46:2c:69", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a229da1-53", "ovs_interfaceid": "5a229da1-537f-4dce-b171-39cf5b5cd438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Converting VIF {"id": "5a229da1-537f-4dce-b171-39cf5b5cd438", "address": "fa:16:3e:46:2c:69", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a229da1-53", "ovs_interfaceid": "5a229da1-537f-4dce-b171-39cf5b5cd438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:2c:69,bridge_name='br-int',has_traffic_filtering=True,id=5a229da1-537f-4dce-b171-39cf5b5cd438,network=Network(73061151-2d01-43ae-9ac6-841d71c038ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a229da1-53') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.objects.instance [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e06aa11-247c-48ff-adc2-f321e6c72f1f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:18:39 user nova-compute[72019]:   <uuid>1e06aa11-247c-48ff-adc2-f321e6c72f1f</uuid>
Apr 14 13:18:39 user nova-compute[72019]:   <name>instance-00000018</name>
Apr 14 13:18:39 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:18:39 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:18:39 user nova-compute[72019]:   <metadata>
Apr 14 13:18:39 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:18:39 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:18:39 user nova-compute[72019]:       <nova:name>tempest-ServersNegativeTestJSON-server-1833341696</nova:name>
Apr 14 13:18:39 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:18:39</nova:creationTime>
Apr 14 13:18:39 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:18:39 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:18:39 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:18:39 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:18:39 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:18:39 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:18:39 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:18:39 user nova-compute[72019]:       <nova:owner>
Apr 14 13:18:39 user nova-compute[72019]:         <nova:user uuid="3f713f95191542f6a23ee25669061b27">tempest-ServersNegativeTestJSON-548588779-project-member</nova:user>
Apr 14 13:18:39 user nova-compute[72019]:         <nova:project uuid="d4b4e44c0b8945079de567503aab3a12">tempest-ServersNegativeTestJSON-548588779</nova:project>
Apr 14 13:18:39 user nova-compute[72019]:       </nova:owner>
Apr 14 13:18:39 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:18:39 user nova-compute[72019]:       <nova:ports>
Apr 14 13:18:39 user nova-compute[72019]:         <nova:port uuid="5a229da1-537f-4dce-b171-39cf5b5cd438">
Apr 14 13:18:39 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 13:18:39 user nova-compute[72019]:         </nova:port>
Apr 14 13:18:39 user nova-compute[72019]:       </nova:ports>
Apr 14 13:18:39 user nova-compute[72019]:     </nova:instance>
Apr 14 13:18:39 user nova-compute[72019]:   </metadata>
Apr 14 13:18:39 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:18:39 user nova-compute[72019]:     <system>
Apr 14 13:18:39 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:18:39 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:18:39 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:18:39 user nova-compute[72019]:       <entry name="serial">1e06aa11-247c-48ff-adc2-f321e6c72f1f</entry>
Apr 14 13:18:39 user nova-compute[72019]:       <entry name="uuid">1e06aa11-247c-48ff-adc2-f321e6c72f1f</entry>
Apr 14 13:18:39 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:18:39 user nova-compute[72019]:     </system>
Apr 14 13:18:39 user nova-compute[72019]:   </sysinfo>
Apr 14 13:18:39 user nova-compute[72019]:   <os>
Apr 14 13:18:39 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:18:39 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:18:39 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:18:39 user nova-compute[72019]:   </os>
Apr 14 13:18:39 user nova-compute[72019]:   <features>
Apr 14 13:18:39 user nova-compute[72019]:     <acpi/>
Apr 14 13:18:39 user nova-compute[72019]:     <apic/>
Apr 14 13:18:39 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:18:39 user nova-compute[72019]:   </features>
Apr 14 13:18:39 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:18:39 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:18:39 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:18:39 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:18:39 user nova-compute[72019]:   </clock>
Apr 14 13:18:39 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:18:39 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:18:39 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:18:39 user nova-compute[72019]:   </cpu>
Apr 14 13:18:39 user nova-compute[72019]:   <devices>
Apr 14 13:18:39 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:18:39 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:18:39 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/disk"/>
Apr 14 13:18:39 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:18:39 user nova-compute[72019]:     </disk>
Apr 14 13:18:39 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:18:39 user nova-compute[72019]:       <mac address="fa:16:3e:46:2c:69"/>
Apr 14 13:18:39 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:18:39 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:18:39 user nova-compute[72019]:       <target dev="tap5a229da1-53"/>
Apr 14 13:18:39 user nova-compute[72019]:     </interface>
Apr 14 13:18:39 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:18:39 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/console.log" append="off"/>
Apr 14 13:18:39 user nova-compute[72019]:     </serial>
Apr 14 13:18:39 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:18:39 user nova-compute[72019]:     <video>
Apr 14 13:18:39 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:18:39 user nova-compute[72019]:     </video>
Apr 14 13:18:39 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:18:39 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:18:39 user nova-compute[72019]:     </rng>
Apr 14 13:18:39 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:18:39 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:18:39 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:18:39 user nova-compute[72019]:     </memballoon>
Apr 14 13:18:39 user nova-compute[72019]:   </devices>
Apr 14 13:18:39 user nova-compute[72019]: </domain>
Apr 14 13:18:39 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1833341696',display_name='tempest-ServersNegativeTestJSON-server-1833341696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1833341696',id=24,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4b4e44c0b8945079de567503aab3a12',ramdisk_id='',reservation_id='r-3r68qu7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-548588779',owner_user_name='tempest-ServersNegativeTestJSON-548588779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:18:36Z,user_data=None,user_id='3f713f95191542f6a23ee25669061b27',uuid=1e06aa11-247c-48ff-adc2-f321e6c72f1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a229da1-537f-4dce-b171-39cf5b5cd438", "address": "fa:16:3e:46:2c:69", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a229da1-53", "ovs_interfaceid": "5a229da1-537f-4dce-b171-39cf5b5cd438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Converting VIF {"id": "5a229da1-537f-4dce-b171-39cf5b5cd438", "address": "fa:16:3e:46:2c:69", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a229da1-53", "ovs_interfaceid": "5a229da1-537f-4dce-b171-39cf5b5cd438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:2c:69,bridge_name='br-int',has_traffic_filtering=True,id=5a229da1-537f-4dce-b171-39cf5b5cd438,network=Network(73061151-2d01-43ae-9ac6-841d71c038ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a229da1-53') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG os_vif [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:2c:69,bridge_name='br-int',has_traffic_filtering=True,id=5a229da1-537f-4dce-b171-39cf5b5cd438,network=Network(73061151-2d01-43ae-9ac6-841d71c038ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a229da1-53') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a229da1-53, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5a229da1-53, col_values=(('external_ids', {'iface-id': '5a229da1-537f-4dce-b171-39cf5b5cd438', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:2c:69', 'vm-uuid': '1e06aa11-247c-48ff-adc2-f321e6c72f1f'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:39 user nova-compute[72019]: INFO os_vif [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:2c:69,bridge_name='br-int',has_traffic_filtering=True,id=5a229da1-537f-4dce-b171-39cf5b5cd438,network=Network(73061151-2d01-43ae-9ac6-841d71c038ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a229da1-53')
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:18:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] No VIF found with MAC fa:16:3e:46:2c:69, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:18:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:18:40 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 13:18:40 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:18:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr3qtorsf/15329d907af54185854a8993d0f87f9b.delta /opt/stack/data/nova/instances/snapshots/tmpr3qtorsf/15329d907af54185854a8993d0f87f9b {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "c74c3463-6701-4150-9096-1775785e8e2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "c74c3463-6701-4150-9096-1775785e8e2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "c74c3463-6701-4150-9096-1775785e8e2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "c74c3463-6701-4150-9096-1775785e8e2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "c74c3463-6701-4150-9096-1775785e8e2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:40 user nova-compute[72019]: INFO nova.compute.manager [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Terminating instance
Apr 14 13:18:40 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:18:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr3qtorsf/15329d907af54185854a8993d0f87f9b.delta /opt/stack/data/nova/instances/snapshots/tmpr3qtorsf/15329d907af54185854a8993d0f87f9b" returned: 0 in 0.466s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:40 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Snapshot extracted, beginning image upload
Apr 14 13:18:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-fb085b6c-655b-479e-b424-3694ce83f551 req-cbf77c39-3ec2-4ff3-b363-57b9453b8cc9 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Received event network-vif-unplugged-81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:18:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb085b6c-655b-479e-b424-3694ce83f551 req-cbf77c39-3ec2-4ff3-b363-57b9453b8cc9 service nova] Acquiring lock "c74c3463-6701-4150-9096-1775785e8e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb085b6c-655b-479e-b424-3694ce83f551 req-cbf77c39-3ec2-4ff3-b363-57b9453b8cc9 service nova] Lock "c74c3463-6701-4150-9096-1775785e8e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb085b6c-655b-479e-b424-3694ce83f551 req-cbf77c39-3ec2-4ff3-b363-57b9453b8cc9 service nova] Lock "c74c3463-6701-4150-9096-1775785e8e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-fb085b6c-655b-479e-b424-3694ce83f551 req-cbf77c39-3ec2-4ff3-b363-57b9453b8cc9 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] No waiting events found dispatching network-vif-unplugged-81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:18:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-fb085b6c-655b-479e-b424-3694ce83f551 req-cbf77c39-3ec2-4ff3-b363-57b9453b8cc9 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Received event network-vif-unplugged-81acf974-1e47-44a8-822c-3d47187e3ae5 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:18:41 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Instance destroyed successfully.
Apr 14 13:18:41 user nova-compute[72019]: DEBUG nova.objects.instance [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lazy-loading 'resources' on Instance uuid c74c3463-6701-4150-9096-1775785e8e2a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:18:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1633441671',display_name='tempest-VolumesAdminNegativeTest-server-1633441671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1633441671',id=6,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdzdkPoVoit7lM3kjI305ncqTC0UPXvZNd8OkmDGnxotdmDaGo3cP0vK31jvHAe3ky9EBQegBgROUmRg4RyBIdIiQhUaixyXIvR1O427vpvxjKBK1aHC8LxkumxfrfRAQ==',key_name='tempest-keypair-482581034',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:13:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9094bc9720194f02abdc6d0b081c7e32',ramdisk_id='',reservation_id='r-0umzhlb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1303459042',owner_user_name='tempest-VolumesAdminNegativeTest-1303459042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:13:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1387c0adbe74072b52886ddc2af4182',uuid=c74c3463-6701-4150-9096-1775785e8e2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81acf974-1e47-44a8-822c-3d47187e3ae5", "address": "fa:16:3e:86:67:71", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81acf974-1e", "ovs_interfaceid": "81acf974-1e47-44a8-822c-3d47187e3ae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:18:42 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Converting VIF {"id": "81acf974-1e47-44a8-822c-3d47187e3ae5", "address": "fa:16:3e:86:67:71", "network": {"id": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2013438621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9094bc9720194f02abdc6d0b081c7e32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81acf974-1e", "ovs_interfaceid": "81acf974-1e47-44a8-822c-3d47187e3ae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:18:42 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:67:71,bridge_name='br-int',has_traffic_filtering=True,id=81acf974-1e47-44a8-822c-3d47187e3ae5,network=Network(ac0fadd7-d406-42a9-84c3-72fcfa33dc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81acf974-1e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:18:42 user nova-compute[72019]: DEBUG os_vif [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:67:71,bridge_name='br-int',has_traffic_filtering=True,id=81acf974-1e47-44a8-822c-3d47187e3ae5,network=Network(ac0fadd7-d406-42a9-84c3-72fcfa33dc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81acf974-1e') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:18:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81acf974-1e, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:18:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:18:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:42 user nova-compute[72019]: INFO os_vif [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:67:71,bridge_name='br-int',has_traffic_filtering=True,id=81acf974-1e47-44a8-822c-3d47187e3ae5,network=Network(ac0fadd7-d406-42a9-84c3-72fcfa33dc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81acf974-1e')
Apr 14 13:18:42 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Deleting instance files /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a_del
Apr 14 13:18:42 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Deletion of /opt/stack/data/nova/instances/c74c3463-6701-4150-9096-1775785e8e2a_del complete
Apr 14 13:18:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:42 user nova-compute[72019]: INFO nova.compute.manager [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Took 1.53 seconds to destroy the instance on the hypervisor.
Apr 14 13:18:42 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:18:42 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:18:42 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: c74c3463-6701-4150-9096-1775785e8e2a] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:18:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Received event network-vif-plugged-81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:18:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Acquiring lock "c74c3463-6701-4150-9096-1775785e8e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Lock "c74c3463-6701-4150-9096-1775785e8e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Lock "c74c3463-6701-4150-9096-1775785e8e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] No waiting events found dispatching network-vif-plugged-81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:18:43 user nova-compute[72019]: WARNING nova.compute.manager [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Received unexpected event network-vif-plugged-81acf974-1e47-44a8-822c-3d47187e3ae5 for instance with vm_state active and task_state deleting.
Apr 14 13:18:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Received event network-vif-plugged-5a229da1-537f-4dce-b171-39cf5b5cd438 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:18:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Acquiring lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] No waiting events found dispatching network-vif-plugged-5a229da1-537f-4dce-b171-39cf5b5cd438 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:18:43 user nova-compute[72019]: WARNING nova.compute.manager [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Received unexpected event network-vif-plugged-5a229da1-537f-4dce-b171-39cf5b5cd438 for instance with vm_state building and task_state spawning.
Apr 14 13:18:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Received event network-vif-plugged-5a229da1-537f-4dce-b171-39cf5b5cd438 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:18:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Acquiring lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] No waiting events found dispatching network-vif-plugged-5a229da1-537f-4dce-b171-39cf5b5cd438 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:18:43 user nova-compute[72019]: WARNING nova.compute.manager [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Received unexpected event network-vif-plugged-5a229da1-537f-4dce-b171-39cf5b5cd438 for instance with vm_state building and task_state spawning.
Apr 14 13:18:43 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:18:43 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Took 1.52 seconds to deallocate network for instance.
Apr 14 13:18:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:44 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Snapshot image upload complete
Apr 14 13:18:44 user nova-compute[72019]: INFO nova.compute.manager [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Took 7.44 seconds to snapshot the instance on the hypervisor.
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:18:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:44 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Deleted allocations for instance c74c3463-6701-4150-9096-1775785e8e2a
Apr 14 13:18:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "c74c3463-6701-4150-9096-1775785e8e2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.691s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478324.8419185, 1e06aa11-247c-48ff-adc2-f321e6c72f1f => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:18:44 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] VM Resumed (Lifecycle Event)
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:18:44 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Instance spawned successfully.
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:18:44 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478324.8444726, 1e06aa11-247c-48ff-adc2-f321e6c72f1f => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:18:44 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] VM Started (Lifecycle Event)
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:18:44 user nova-compute[72019]: INFO nova.compute.manager [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Took 8.31 seconds to spawn the instance on the hypervisor.
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:18:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:18:45 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:18:45 user nova-compute[72019]: INFO nova.compute.manager [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Took 11.27 seconds to build instance.
Apr 14 13:18:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.373s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:45 user nova-compute[72019]: DEBUG nova.compute.manager [req-dc1141b6-5a5c-408d-9838-96a0766594af req-b1eec805-ea58-4142-aa3c-b66abedf6367 service nova] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Received event network-vif-deleted-81acf974-1e47-44a8-822c-3d47187e3ae5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:18:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG nova.objects.instance [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lazy-loading 'flavor' on Instance uuid 2c051c82-e56a-4a50-a24b-23eb2136f3ee {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:18:49 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Ignoring supplied device name: /dev/vdb
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:18:49 user nova-compute[72019]: INFO nova.compute.manager [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Attaching volume ca4b4bd0-29f5-493d-aec2-cf7c01445f27 to /dev/vdb
Apr 14 13:18:49 user nova-compute[72019]: DEBUG os_brick.utils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[539e8972-0365-41b6-aca0-a82daa1c0d14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a92bb35-e14b-403c-a8f6-e09ca75f044d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf771fdb-99fa-44a6-8e46-34cceb874a9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa22add-c0f2-457e-957c-4daa0736ae6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:18:49 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:18:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f5ed9d-19fd-40b7-b413-72891ea3ca88]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG os_brick.utils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:18:49 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Updating existing volume attachment record: b4040deb-7c3f-4f5b-9bd4-c8598a0ba5bf {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:18:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:18:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:18:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:18:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:18:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHNbIfVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:18:54 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:18:54 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:18:54 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7816bb-1972-4f7b-a9de-7af0e9f7c3ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:18:54 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a536dcb-e493-4426-82f9-fd41ac99fc4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27] added
Apr 14 13:18:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4046cdd-7b4d-4f06-956a-31cc5208d91c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1748207-382c-4fcc-b726-7b93e95a8ad1]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JHNbIfVl {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JHNbIfVl" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[53abaf3b-08f3-4b60-b0d6-66f2770ebfef]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JHNbIfVl'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe79c3c8-0d1a-4b96-918f-72f77d3903e2]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a171b5-ef9f-4a14-9bc3-8b5b67f5a7b7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 13:18:54 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 13:18:54 user nova-compute[72019]:  {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:18:54 user nova-compute[72019]: WARNING os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 13:18:54 user nova-compute[72019]: 
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f67a511-06be-41bd-b413-e0e3aaa0f100]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27, portal: 172.16.0.220,3260]
Apr 14 13:18:54 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27, portal: 172.16.0.220,3260] successful.
Apr 14 13:18:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0028cdb-cd8f-40fa-9b49-a48f8786ddcd]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1c8661-9535-4cb8-8577-11ac589c733f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 (non-flash)
Apr 14 13:18:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 (non-flash)
Apr 14 13:18:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da0badd-b281-48d9-8a66-083f16673c50]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:18:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:18:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:18:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHNbIfVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:18:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:18:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23332346466653032', 'path': '/dev/sdb'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:18:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332346466653032', 'path': '/dev/sdb'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:18:55 user nova-compute[72019]: DEBUG nova.objects.instance [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lazy-loading 'flavor' on Instance uuid 2c051c82-e56a-4a50-a24b-23eb2136f3ee {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:18:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:18:55 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:18:55 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:18:55 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:18:55 user nova-compute[72019]:   <serial>ca4b4bd0-29f5-493d-aec2-cf7c01445f27</serial>
Apr 14 13:18:55 user nova-compute[72019]: </disk>
Apr 14 13:18:55 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:18:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:18:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:18:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] No VIF found with MAC fa:16:3e:62:a4:a3, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:18:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.812s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:18:56 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478321.9648488, c74c3463-6701-4150-9096-1775785e8e2a => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:18:56 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: c74c3463-6701-4150-9096-1775785e8e2a] VM Stopped (Lifecycle Event)
Apr 14 13:18:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-97c34d03-a1df-4c32-841e-2b500574131c None None] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:18:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:18:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:18:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:18:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:18:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:18:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:05 user nova-compute[72019]: DEBUG nova.compute.manager [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:19:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:05 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:19:05 user nova-compute[72019]: INFO nova.compute.claims [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Claim successful on node user
Apr 14 13:19:05 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:19:05 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:19:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:05 user nova-compute[72019]: DEBUG nova.compute.manager [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:19:05 user nova-compute[72019]: DEBUG nova.compute.manager [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:19:05 user nova-compute[72019]: DEBUG nova.network.neutron [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:19:05 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:19:05 user nova-compute[72019]: DEBUG nova.compute.manager [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG nova.compute.manager [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:19:06 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Creating image(s)
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "/opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "/opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG nova.policy [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0868a82043f44a7bc91fc8c6785dc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea4bc3b35746889e1f72cd621d501b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk 1073741824" returned: 0 in 0.050s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Cannot resize image /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG nova.objects.instance [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lazy-loading 'migration_context' on Instance uuid 0e675870-c86b-4ac2-a581-dbad2bdb71ec {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Ensure instance console log exists: /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:07 user nova-compute[72019]: DEBUG nova.network.neutron [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Successfully created port: 55e6da39-5c8f-43dc-a24b-cd2e266b4752 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:19:07 user nova-compute[72019]: DEBUG nova.network.neutron [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Successfully updated port: 55e6da39-5c8f-43dc-a24b-cd2e266b4752 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:19:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "refresh_cache-0e675870-c86b-4ac2-a581-dbad2bdb71ec" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:19:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquired lock "refresh_cache-0e675870-c86b-4ac2-a581-dbad2bdb71ec" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:19:07 user nova-compute[72019]: DEBUG nova.network.neutron [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:19:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-bae0c4ff-3aa8-45b4-9abb-461184ec398b req-ce604178-bf63-4b99-baa0-5ea466de9043 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Received event network-changed-55e6da39-5c8f-43dc-a24b-cd2e266b4752 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-bae0c4ff-3aa8-45b4-9abb-461184ec398b req-ce604178-bf63-4b99-baa0-5ea466de9043 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Refreshing instance network info cache due to event network-changed-55e6da39-5c8f-43dc-a24b-cd2e266b4752. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:19:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-bae0c4ff-3aa8-45b4-9abb-461184ec398b req-ce604178-bf63-4b99-baa0-5ea466de9043 service nova] Acquiring lock "refresh_cache-0e675870-c86b-4ac2-a581-dbad2bdb71ec" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.network.neutron [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.network.neutron [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Updating instance_info_cache with network_info: [{"id": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "address": "fa:16:3e:c4:fe:fe", "network": {"id": "18472354-e0f8-402a-ac00-3beb5e5b7341", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae9501805cab47aaa3a6e2553987bd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e6da39-5c", "ovs_interfaceid": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Releasing lock "refresh_cache-0e675870-c86b-4ac2-a581-dbad2bdb71ec" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Instance network_info: |[{"id": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "address": "fa:16:3e:c4:fe:fe", "network": {"id": "18472354-e0f8-402a-ac00-3beb5e5b7341", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae9501805cab47aaa3a6e2553987bd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e6da39-5c", "ovs_interfaceid": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-bae0c4ff-3aa8-45b4-9abb-461184ec398b req-ce604178-bf63-4b99-baa0-5ea466de9043 service nova] Acquired lock "refresh_cache-0e675870-c86b-4ac2-a581-dbad2bdb71ec" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.network.neutron [req-bae0c4ff-3aa8-45b4-9abb-461184ec398b req-ce604178-bf63-4b99-baa0-5ea466de9043 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Refreshing network info cache for port 55e6da39-5c8f-43dc-a24b-cd2e266b4752 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Start _get_guest_xml network_info=[{"id": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "address": "fa:16:3e:c4:fe:fe", "network": {"id": "18472354-e0f8-402a-ac00-3beb5e5b7341", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae9501805cab47aaa3a6e2553987bd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e6da39-5c", "ovs_interfaceid": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:19:08 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:19:08 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1043455417',display_name='tempest-VolumesNegativeTest-instance-1043455417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1043455417',id=25,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcea4bc3b35746889e1f72cd621d501b',ramdisk_id='',reservation_id='r-uhzfi7wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1899611102',owner_user_name='tempest-VolumesNegativeTest-1899611102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:19:06Z,user_data=None,user_id='f0868a82043f44a7bc91fc8c6785dc1e',uuid=0e675870-c86b-4ac2-a581-dbad2bdb71ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "address": "fa:16:3e:c4:fe:fe", "network": {"id": "18472354-e0f8-402a-ac00-3beb5e5b7341", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae9501805cab47aaa3a6e2553987bd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e6da39-5c", "ovs_interfaceid": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Converting VIF {"id": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "address": "fa:16:3e:c4:fe:fe", "network": {"id": "18472354-e0f8-402a-ac00-3beb5e5b7341", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae9501805cab47aaa3a6e2553987bd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e6da39-5c", "ovs_interfaceid": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fe:fe,bridge_name='br-int',has_traffic_filtering=True,id=55e6da39-5c8f-43dc-a24b-cd2e266b4752,network=Network(18472354-e0f8-402a-ac00-3beb5e5b7341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e6da39-5c') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.objects.instance [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e675870-c86b-4ac2-a581-dbad2bdb71ec {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:19:08 user nova-compute[72019]:   <uuid>0e675870-c86b-4ac2-a581-dbad2bdb71ec</uuid>
Apr 14 13:19:08 user nova-compute[72019]:   <name>instance-00000019</name>
Apr 14 13:19:08 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:19:08 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:19:08 user nova-compute[72019]:   <metadata>
Apr 14 13:19:08 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:19:08 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:19:08 user nova-compute[72019]:       <nova:name>tempest-VolumesNegativeTest-instance-1043455417</nova:name>
Apr 14 13:19:08 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:19:08</nova:creationTime>
Apr 14 13:19:08 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:19:08 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:19:08 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:19:08 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:19:08 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:19:08 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:19:08 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:19:08 user nova-compute[72019]:       <nova:owner>
Apr 14 13:19:08 user nova-compute[72019]:         <nova:user uuid="f0868a82043f44a7bc91fc8c6785dc1e">tempest-VolumesNegativeTest-1899611102-project-member</nova:user>
Apr 14 13:19:08 user nova-compute[72019]:         <nova:project uuid="fcea4bc3b35746889e1f72cd621d501b">tempest-VolumesNegativeTest-1899611102</nova:project>
Apr 14 13:19:08 user nova-compute[72019]:       </nova:owner>
Apr 14 13:19:08 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:19:08 user nova-compute[72019]:       <nova:ports>
Apr 14 13:19:08 user nova-compute[72019]:         <nova:port uuid="55e6da39-5c8f-43dc-a24b-cd2e266b4752">
Apr 14 13:19:08 user nova-compute[72019]:           <nova:ip type="fixed" address="192.168.233.216" ipVersion="4"/>
Apr 14 13:19:08 user nova-compute[72019]:         </nova:port>
Apr 14 13:19:08 user nova-compute[72019]:       </nova:ports>
Apr 14 13:19:08 user nova-compute[72019]:     </nova:instance>
Apr 14 13:19:08 user nova-compute[72019]:   </metadata>
Apr 14 13:19:08 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:19:08 user nova-compute[72019]:     <system>
Apr 14 13:19:08 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:19:08 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:19:08 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:19:08 user nova-compute[72019]:       <entry name="serial">0e675870-c86b-4ac2-a581-dbad2bdb71ec</entry>
Apr 14 13:19:08 user nova-compute[72019]:       <entry name="uuid">0e675870-c86b-4ac2-a581-dbad2bdb71ec</entry>
Apr 14 13:19:08 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:19:08 user nova-compute[72019]:     </system>
Apr 14 13:19:08 user nova-compute[72019]:   </sysinfo>
Apr 14 13:19:08 user nova-compute[72019]:   <os>
Apr 14 13:19:08 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:19:08 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:19:08 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:19:08 user nova-compute[72019]:   </os>
Apr 14 13:19:08 user nova-compute[72019]:   <features>
Apr 14 13:19:08 user nova-compute[72019]:     <acpi/>
Apr 14 13:19:08 user nova-compute[72019]:     <apic/>
Apr 14 13:19:08 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:19:08 user nova-compute[72019]:   </features>
Apr 14 13:19:08 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:19:08 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:19:08 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:19:08 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:19:08 user nova-compute[72019]:   </clock>
Apr 14 13:19:08 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:19:08 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:19:08 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:19:08 user nova-compute[72019]:   </cpu>
Apr 14 13:19:08 user nova-compute[72019]:   <devices>
Apr 14 13:19:08 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:19:08 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:19:08 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk"/>
Apr 14 13:19:08 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:19:08 user nova-compute[72019]:     </disk>
Apr 14 13:19:08 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:19:08 user nova-compute[72019]:       <mac address="fa:16:3e:c4:fe:fe"/>
Apr 14 13:19:08 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:19:08 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:19:08 user nova-compute[72019]:       <target dev="tap55e6da39-5c"/>
Apr 14 13:19:08 user nova-compute[72019]:     </interface>
Apr 14 13:19:08 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:19:08 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/console.log" append="off"/>
Apr 14 13:19:08 user nova-compute[72019]:     </serial>
Apr 14 13:19:08 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:19:08 user nova-compute[72019]:     <video>
Apr 14 13:19:08 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:19:08 user nova-compute[72019]:     </video>
Apr 14 13:19:08 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:19:08 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:19:08 user nova-compute[72019]:     </rng>
Apr 14 13:19:08 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:19:08 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:19:08 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:19:08 user nova-compute[72019]:     </memballoon>
Apr 14 13:19:08 user nova-compute[72019]:   </devices>
Apr 14 13:19:08 user nova-compute[72019]: </domain>
Apr 14 13:19:08 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1043455417',display_name='tempest-VolumesNegativeTest-instance-1043455417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1043455417',id=25,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcea4bc3b35746889e1f72cd621d501b',ramdisk_id='',reservation_id='r-uhzfi7wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1899611102',owner_user_name='tempest-VolumesNegativeTest-1899611102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:19:06Z,user_data=None,user_id='f0868a82043f44a7bc91fc8c6785dc1e',uuid=0e675870-c86b-4ac2-a581-dbad2bdb71ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "address": "fa:16:3e:c4:fe:fe", "network": {"id": "18472354-e0f8-402a-ac00-3beb5e5b7341", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae9501805cab47aaa3a6e2553987bd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e6da39-5c", "ovs_interfaceid": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Converting VIF {"id": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "address": "fa:16:3e:c4:fe:fe", "network": {"id": "18472354-e0f8-402a-ac00-3beb5e5b7341", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae9501805cab47aaa3a6e2553987bd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e6da39-5c", "ovs_interfaceid": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fe:fe,bridge_name='br-int',has_traffic_filtering=True,id=55e6da39-5c8f-43dc-a24b-cd2e266b4752,network=Network(18472354-e0f8-402a-ac00-3beb5e5b7341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e6da39-5c') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG os_vif [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fe:fe,bridge_name='br-int',has_traffic_filtering=True,id=55e6da39-5c8f-43dc-a24b-cd2e266b4752,network=Network(18472354-e0f8-402a-ac00-3beb5e5b7341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e6da39-5c') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55e6da39-5c, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55e6da39-5c, col_values=(('external_ids', {'iface-id': '55e6da39-5c8f-43dc-a24b-cd2e266b4752', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:fe:fe', 'vm-uuid': '0e675870-c86b-4ac2-a581-dbad2bdb71ec'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:08 user nova-compute[72019]: INFO os_vif [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fe:fe,bridge_name='br-int',has_traffic_filtering=True,id=55e6da39-5c8f-43dc-a24b-cd2e266b4752,network=Network(18472354-e0f8-402a-ac00-3beb5e5b7341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e6da39-5c')
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:19:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] No VIF found with MAC fa:16:3e:c4:fe:fe, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:19:09 user nova-compute[72019]: DEBUG nova.network.neutron [req-bae0c4ff-3aa8-45b4-9abb-461184ec398b req-ce604178-bf63-4b99-baa0-5ea466de9043 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Updated VIF entry in instance network info cache for port 55e6da39-5c8f-43dc-a24b-cd2e266b4752. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:19:09 user nova-compute[72019]: DEBUG nova.network.neutron [req-bae0c4ff-3aa8-45b4-9abb-461184ec398b req-ce604178-bf63-4b99-baa0-5ea466de9043 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Updating instance_info_cache with network_info: [{"id": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "address": "fa:16:3e:c4:fe:fe", "network": {"id": "18472354-e0f8-402a-ac00-3beb5e5b7341", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae9501805cab47aaa3a6e2553987bd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e6da39-5c", "ovs_interfaceid": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-bae0c4ff-3aa8-45b4-9abb-461184ec398b req-ce604178-bf63-4b99-baa0-5ea466de9043 service nova] Releasing lock "refresh_cache-0e675870-c86b-4ac2-a581-dbad2bdb71ec" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:19:09 user nova-compute[72019]: INFO nova.compute.manager [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Unrescuing
Apr 14 13:19:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:19:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquired lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:19:09 user nova-compute[72019]: DEBUG nova.network.neutron [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:19:09 user nova-compute[72019]: DEBUG nova.network.neutron [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Updating instance_info_cache with network_info: [{"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Releasing lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:19:09 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'flavor' on Instance uuid 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-5c5baf6a-9bfd-43c8-bfc0-434e7262075e req-e6cd47db-0f24-4399-9aec-4f9afe465496 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-vif-unplugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5c5baf6a-9bfd-43c8-bfc0-434e7262075e req-e6cd47db-0f24-4399-9aec-4f9afe465496 service nova] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5c5baf6a-9bfd-43c8-bfc0-434e7262075e req-e6cd47db-0f24-4399-9aec-4f9afe465496 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5c5baf6a-9bfd-43c8-bfc0-434e7262075e req-e6cd47db-0f24-4399-9aec-4f9afe465496 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-5c5baf6a-9bfd-43c8-bfc0-434e7262075e req-e6cd47db-0f24-4399-9aec-4f9afe465496 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] No waiting events found dispatching network-vif-unplugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:10 user nova-compute[72019]: WARNING nova.compute.manager [req-5c5baf6a-9bfd-43c8-bfc0-434e7262075e req-e6cd47db-0f24-4399-9aec-4f9afe465496 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received unexpected event network-vif-unplugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:19:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d2e40af-df9c-455b-ba4e-bccaf1b51b16 req-e6b47812-6e20-4658-b73d-6759a573b9ce service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Received event network-vif-plugged-55e6da39-5c8f-43dc-a24b-cd2e266b4752 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d2e40af-df9c-455b-ba4e-bccaf1b51b16 req-e6b47812-6e20-4658-b73d-6759a573b9ce service nova] Acquiring lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d2e40af-df9c-455b-ba4e-bccaf1b51b16 req-e6b47812-6e20-4658-b73d-6759a573b9ce service nova] Lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d2e40af-df9c-455b-ba4e-bccaf1b51b16 req-e6b47812-6e20-4658-b73d-6759a573b9ce service nova] Lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d2e40af-df9c-455b-ba4e-bccaf1b51b16 req-e6b47812-6e20-4658-b73d-6759a573b9ce service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] No waiting events found dispatching network-vif-plugged-55e6da39-5c8f-43dc-a24b-cd2e266b4752 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:10 user nova-compute[72019]: WARNING nova.compute.manager [req-4d2e40af-df9c-455b-ba4e-bccaf1b51b16 req-e6b47812-6e20-4658-b73d-6759a573b9ce service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Received unexpected event network-vif-plugged-55e6da39-5c8f-43dc-a24b-cd2e266b4752 for instance with vm_state building and task_state spawning.
Apr 14 13:19:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:10 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Instance destroyed successfully.
Apr 14 13:19:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-83b9edc0-fed5-4dd6-b12c-2544fad342b4 req-ee58784c-0b40-4feb-b957-b31965002483 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-83b9edc0-fed5-4dd6-b12c-2544fad342b4 req-ee58784c-0b40-4feb-b957-b31965002483 service nova] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-83b9edc0-fed5-4dd6-b12c-2544fad342b4 req-ee58784c-0b40-4feb-b957-b31965002483 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-83b9edc0-fed5-4dd6-b12c-2544fad342b4 req-ee58784c-0b40-4feb-b957-b31965002483 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-83b9edc0-fed5-4dd6-b12c-2544fad342b4 req-ee58784c-0b40-4feb-b957-b31965002483 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] No waiting events found dispatching network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:12 user nova-compute[72019]: WARNING nova.compute.manager [req-83b9edc0-fed5-4dd6-b12c-2544fad342b4 req-ee58784c-0b40-4feb-b957-b31965002483 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received unexpected event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:19:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-38fd1038-893c-4c42-8782-ab58ca3b116c req-836ffbf7-a31a-4f01-96f9-6d8f88bf9bb8 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Received event network-vif-plugged-55e6da39-5c8f-43dc-a24b-cd2e266b4752 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-38fd1038-893c-4c42-8782-ab58ca3b116c req-836ffbf7-a31a-4f01-96f9-6d8f88bf9bb8 service nova] Acquiring lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-38fd1038-893c-4c42-8782-ab58ca3b116c req-836ffbf7-a31a-4f01-96f9-6d8f88bf9bb8 service nova] Lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-38fd1038-893c-4c42-8782-ab58ca3b116c req-836ffbf7-a31a-4f01-96f9-6d8f88bf9bb8 service nova] Lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-38fd1038-893c-4c42-8782-ab58ca3b116c req-836ffbf7-a31a-4f01-96f9-6d8f88bf9bb8 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] No waiting events found dispatching network-vif-plugged-55e6da39-5c8f-43dc-a24b-cd2e266b4752 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:12 user nova-compute[72019]: WARNING nova.compute.manager [req-38fd1038-893c-4c42-8782-ab58ca3b116c req-836ffbf7-a31a-4f01-96f9-6d8f88bf9bb8 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Received unexpected event network-vif-plugged-55e6da39-5c8f-43dc-a24b-cd2e266b4752 for instance with vm_state building and task_state spawning.
Apr 14 13:19:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478353.591035, 0e675870-c86b-4ac2-a581-dbad2bdb71ec => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:19:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] VM Resumed (Lifecycle Event)
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:19:13 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Instance spawned successfully.
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:19:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478353.5952296, 0e675870-c86b-4ac2-a581-dbad2bdb71ec => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:19:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] VM Started (Lifecycle Event)
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:19:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:19:13 user nova-compute[72019]: INFO nova.compute.manager [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Took 7.64 seconds to spawn the instance on the hypervisor.
Apr 14 13:19:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:13 user nova-compute[72019]: INFO nova.compute.manager [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Took 8.42 seconds to build instance.
Apr 14 13:19:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.520s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] No waiting events found dispatching network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:14 user nova-compute[72019]: WARNING nova.compute.manager [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received unexpected event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] No waiting events found dispatching network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:14 user nova-compute[72019]: WARNING nova.compute.manager [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received unexpected event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-859a856e-f84d-4b2c-9b21-654b7cdf671e req-2adabdf8-42ef-46b7-8b08-2701a20a3695 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-changed-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-859a856e-f84d-4b2c-9b21-654b7cdf671e req-2adabdf8-42ef-46b7-8b08-2701a20a3695 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Refreshing instance network info cache due to event network-changed-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-859a856e-f84d-4b2c-9b21-654b7cdf671e req-2adabdf8-42ef-46b7-8b08-2701a20a3695 service nova] Acquiring lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-859a856e-f84d-4b2c-9b21-654b7cdf671e req-2adabdf8-42ef-46b7-8b08-2701a20a3695 service nova] Acquired lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.network.neutron [req-859a856e-f84d-4b2c-9b21-654b7cdf671e req-2adabdf8-42ef-46b7-8b08-2701a20a3695 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Refreshing network info cache for port 25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478354.7008507, 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:19:14 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] VM Resumed (Lifecycle Event)
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:14 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478354.7048786, 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:19:14 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] VM Started (Lifecycle Event)
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:14 user nova-compute[72019]: INFO nova.compute.manager [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Detaching volume ca4b4bd0-29f5-493d-aec2-cf7c01445f27
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:19:14 user nova-compute[72019]: INFO nova.compute.claims [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Claim successful on node user
Apr 14 13:19:14 user nova-compute[72019]: INFO nova.virt.block_device [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Attempting to driver detach volume ca4b4bd0-29f5-493d-aec2-cf7c01445f27 from mountpoint /dev/vdb
Apr 14 13:19:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Attempting to detach device vdb from instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:19:15 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:19:15 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:19:15 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:19:15 user nova-compute[72019]:   <serial>ca4b4bd0-29f5-493d-aec2-cf7c01445f27</serial>
Apr 14 13:19:15 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:19:15 user nova-compute[72019]: </disk>
Apr 14 13:19:15 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:19:15 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Successfully detached device vdb from instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee from the persistent domain config.
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:19:15 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:19:15 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:19:15 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:19:15 user nova-compute[72019]:   <serial>ca4b4bd0-29f5-493d-aec2-cf7c01445f27</serial>
Apr 14 13:19:15 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:19:15 user nova-compute[72019]: </disk>
Apr 14 13:19:15 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.network.neutron [req-859a856e-f84d-4b2c-9b21-654b7cdf671e req-2adabdf8-42ef-46b7-8b08-2701a20a3695 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updated VIF entry in instance network info cache for port 25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.network.neutron [req-859a856e-f84d-4b2c-9b21-654b7cdf671e req-2adabdf8-42ef-46b7-8b08-2701a20a3695 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating instance_info_cache with network_info: [{"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-859a856e-f84d-4b2c-9b21-654b7cdf671e req-2adabdf8-42ef-46b7-8b08-2701a20a3695 service nova] Releasing lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.compute.manager [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478355.4977574, 2c051c82-e56a-4a50-a24b-23eb2136f3ee => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:19:15 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Successfully detached device vdb from instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee from the live domain config.
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHNbIfVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:19:15 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d33f1a-cb38-45e6-a98f-761e7525945a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:19:15 user nova-compute[72019]: No targets found.
Apr 14 13:19:15 user nova-compute[72019]: iSNS:
Apr 14 13:19:15 user nova-compute[72019]: No targets found.
Apr 14 13:19:15 user nova-compute[72019]: STATIC:
Apr 14 13:19:15 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27
Apr 14 13:19:15 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:19:15 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:19:15 user nova-compute[72019]: FIRMWARE:
Apr 14 13:19:15 user nova-compute[72019]: No targets found.
Apr 14 13:19:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:19:15 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:19:15 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[097944d5-709d-4698-9b9e-9bd55f722a19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.compute.manager [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.network.neutron [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:15 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf232bd-6af6-44a4-b747-9b6d3e4f05a8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 (non-flash)
Apr 14 13:19:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 (non-flash)
Apr 14 13:19:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74902e9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27'): ({'sdb'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Removing single pathed devices sdb {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.compute.manager [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d83c7b8-0112-49c6-b257-426b4224a6dc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[500a4fc6-ff61-4f31-9b4a-c2f23b4f97cd]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Flushing IO for device /dev/sdb {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c666c9f9-ecc0-4cb7-9fd4-960bc3ed840a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.policy [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.compute.manager [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:19:15 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Creating image(s)
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "/opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "/opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "/opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e5d597-24b4-4f96-a803-9eae5e0dc99e]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ee882d-fbef-40b0-b63b-fc0268386c48]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5be25cc-6008-44e6-8805-84e3ec097e20]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27, portal: 172.16.0.220,3260]
Apr 14 13:19:15 user nova-compute[72019]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27, portal: 172.16.0.220,3260] successful.
Apr 14 13:19:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf9911d-1254-4b8f-a69b-c68c38251b0c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] <== disconnect_volume: return (385ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.210s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.152s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk 1073741824" returned: 0 in 0.059s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.252s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG nova.network.neutron [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Successfully created port: e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Cannot resize image /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG nova.objects.instance [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'migration_context' on Instance uuid dca3424c-cbca-4520-a495-8867c2a9c0c4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Ensure instance console log exists: /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG nova.objects.instance [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lazy-loading 'flavor' on Instance uuid 2c051c82-e56a-4a50-a24b-23eb2136f3ee {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.047s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.926s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:16 user nova-compute[72019]: INFO nova.compute.manager [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Terminating instance
Apr 14 13:19:16 user nova-compute[72019]: DEBUG nova.compute.manager [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-a4ba22fa-0c4e-43c8-a964-b0725583240b req-201fd205-ba4f-47eb-aa6d-0e9feb8b1739 service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Received event network-vif-unplugged-18490e88-a837-4ac8-a475-885551bb6219 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a4ba22fa-0c4e-43c8-a964-b0725583240b req-201fd205-ba4f-47eb-aa6d-0e9feb8b1739 service nova] Acquiring lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a4ba22fa-0c4e-43c8-a964-b0725583240b req-201fd205-ba4f-47eb-aa6d-0e9feb8b1739 service nova] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a4ba22fa-0c4e-43c8-a964-b0725583240b req-201fd205-ba4f-47eb-aa6d-0e9feb8b1739 service nova] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-a4ba22fa-0c4e-43c8-a964-b0725583240b req-201fd205-ba4f-47eb-aa6d-0e9feb8b1739 service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] No waiting events found dispatching network-vif-unplugged-18490e88-a837-4ac8-a475-885551bb6219 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-a4ba22fa-0c4e-43c8-a964-b0725583240b req-201fd205-ba4f-47eb-aa6d-0e9feb8b1739 service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Received event network-vif-unplugged-18490e88-a837-4ac8-a475-885551bb6219 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG nova.network.neutron [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Successfully updated port: e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "refresh_cache-dca3424c-cbca-4520-a495-8867c2a9c0c4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquired lock "refresh_cache-dca3424c-cbca-4520-a495-8867c2a9c0c4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG nova.network.neutron [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG nova.network.neutron [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:19:17 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Instance destroyed successfully.
Apr 14 13:19:17 user nova-compute[72019]: DEBUG nova.objects.instance [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lazy-loading 'resources' on Instance uuid 2c051c82-e56a-4a50-a24b-23eb2136f3ee {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1047339648',display_name='tempest-VolumesSnapshotTestJSON-instance-1047339648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1047339648',id=20,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:17:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fe64d1d65224162b60849eace352cb4',ramdisk_id='',reservation_id='r-qjpuolxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1137775211',owner_user_name='tempest-VolumesSnapshotTestJSON-1137775211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:17:09Z,user_data=None,user_id='0f3445d14b0a44fd999bc2fc875c77bb',uuid=2c051c82-e56a-4a50-a24b-23eb2136f3ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18490e88-a837-4ac8-a475-885551bb6219", "address": "fa:16:3e:62:a4:a3", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18490e88-a8", "ovs_interfaceid": "18490e88-a837-4ac8-a475-885551bb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Converting VIF {"id": "18490e88-a837-4ac8-a475-885551bb6219", "address": "fa:16:3e:62:a4:a3", "network": {"id": "548d2c7a-ae94-4d89-8980-cb14f224fca3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1781144340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4fe64d1d65224162b60849eace352cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18490e88-a8", "ovs_interfaceid": "18490e88-a837-4ac8-a475-885551bb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a4:a3,bridge_name='br-int',has_traffic_filtering=True,id=18490e88-a837-4ac8-a475-885551bb6219,network=Network(548d2c7a-ae94-4d89-8980-cb14f224fca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18490e88-a8') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG os_vif [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a4:a3,bridge_name='br-int',has_traffic_filtering=True,id=18490e88-a837-4ac8-a475-885551bb6219,network=Network(548d2c7a-ae94-4d89-8980-cb14f224fca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18490e88-a8') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18490e88-a8, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:17 user nova-compute[72019]: INFO os_vif [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a4:a3,bridge_name='br-int',has_traffic_filtering=True,id=18490e88-a837-4ac8-a475-885551bb6219,network=Network(548d2c7a-ae94-4d89-8980-cb14f224fca3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18490e88-a8')
Apr 14 13:19:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:ca4b4bd0-29f5-493d-aec2-cf7c01445f27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHNbIfVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:19:17 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:19:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[b067db8c-a98f-495c-9eba-056ff67901ec]: Unexpected error while running command.
Apr 14 13:19:17 user nova-compute[72019]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 13:19:17 user nova-compute[72019]: Exit code: 21
Apr 14 13:19:17 user nova-compute[72019]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 13:19:17 user nova-compute[72019]: Stderr: '' {{(pid=82397) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 14 13:19:17 user nova-compute[72019]: Traceback (most recent call last):
Apr 14 13:19:17 user nova-compute[72019]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 14 13:19:17 user nova-compute[72019]:     ret = func(*f_args, **f_kwargs)
Apr 14 13:19:17 user nova-compute[72019]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 14 13:19:17 user nova-compute[72019]:     return func(*args, **kwargs)
Apr 14 13:19:17 user nova-compute[72019]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 14 13:19:17 user nova-compute[72019]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 14 13:19:17 user nova-compute[72019]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 14 13:19:17 user nova-compute[72019]:     return putils.execute(on_execute=on_execute,
Apr 14 13:19:17 user nova-compute[72019]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 14 13:19:17 user nova-compute[72019]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 14 13:19:17 user nova-compute[72019]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 13:19:17 user nova-compute[72019]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 13:19:17 user nova-compute[72019]: Exit code: 21
Apr 14 13:19:17 user nova-compute[72019]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 13:19:17 user nova-compute[72019]: Stderr: ''
Apr 14 13:19:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b067db8c-a98f-495c-9eba-056ff67901ec]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 13:19:17 user nova-compute[72019]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 13:19:17 user nova-compute[72019]: Exit code: 21
Apr 14 13:19:17 user nova-compute[72019]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 13:19:17 user nova-compute[72019]: Stderr: ''
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 14 13:19:17 user nova-compute[72019]: ERROR os_brick.initiator.connectors.iscsi 
Apr 14 13:19:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=72019) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.044s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] <== disconnect_volume: return (45ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:19:17 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Deleting instance files /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee_del
Apr 14 13:19:17 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Deletion of /opt/stack/data/nova/instances/2c051c82-e56a-4a50-a24b-23eb2136f3ee_del complete
Apr 14 13:19:17 user nova-compute[72019]: INFO nova.compute.manager [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Took 1.00 seconds to destroy the instance on the hypervisor.
Apr 14 13:19:17 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:19:17 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.network.neutron [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Updating instance_info_cache with network_info: [{"id": "e4d4e52c-5363-4345-9db1-022e8287c65a", "address": "fa:16:3e:dd:8e:8b", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d4e52c-53", "ovs_interfaceid": "e4d4e52c-5363-4345-9db1-022e8287c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Releasing lock "refresh_cache-dca3424c-cbca-4520-a495-8867c2a9c0c4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.compute.manager [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Instance network_info: |[{"id": "e4d4e52c-5363-4345-9db1-022e8287c65a", "address": "fa:16:3e:dd:8e:8b", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d4e52c-53", "ovs_interfaceid": "e4d4e52c-5363-4345-9db1-022e8287c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Start _get_guest_xml network_info=[{"id": "e4d4e52c-5363-4345-9db1-022e8287c65a", "address": "fa:16:3e:dd:8e:8b", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d4e52c-53", "ovs_interfaceid": "e4d4e52c-5363-4345-9db1-022e8287c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:19:18 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:19:18 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:19:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1960301141',display_name='tempest-AttachVolumeNegativeTest-server-1960301141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1960301141',id=26,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH4IGWPc2G0woSBSu59i2dIWuZuV2nLiEWGcOxBrVeMBfugBK5jZvg3HQO8pKqc4IgnzE7IGw/8/i8zne6vY1fFpHLFViOafQnKXwfPPryecMrr8w+IVET1IuOjpJRNTA==',key_name='tempest-keypair-858857094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6833a69217034c4d85ff10bf8aa2fa5c',ramdisk_id='',reservation_id='r-amlcx4kr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-893959880',owner_user_name='tempest-AttachVolumeNegativeTest-893959880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:19:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65812c6559684eddbdde33cd64ca1fba',uuid=dca3424c-cbca-4520-a495-8867c2a9c0c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4d4e52c-5363-4345-9db1-022e8287c65a", "address": "fa:16:3e:dd:8e:8b", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d4e52c-53", "ovs_interfaceid": "e4d4e52c-5363-4345-9db1-022e8287c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converting VIF {"id": "e4d4e52c-5363-4345-9db1-022e8287c65a", "address": "fa:16:3e:dd:8e:8b", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d4e52c-53", "ovs_interfaceid": "e4d4e52c-5363-4345-9db1-022e8287c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8e:8b,bridge_name='br-int',has_traffic_filtering=True,id=e4d4e52c-5363-4345-9db1-022e8287c65a,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d4e52c-53') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.objects.instance [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'pci_devices' on Instance uuid dca3424c-cbca-4520-a495-8867c2a9c0c4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:19:18 user nova-compute[72019]:   <uuid>dca3424c-cbca-4520-a495-8867c2a9c0c4</uuid>
Apr 14 13:19:18 user nova-compute[72019]:   <name>instance-0000001a</name>
Apr 14 13:19:18 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:19:18 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:19:18 user nova-compute[72019]:   <metadata>
Apr 14 13:19:18 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:19:18 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:19:18 user nova-compute[72019]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1960301141</nova:name>
Apr 14 13:19:18 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:19:18</nova:creationTime>
Apr 14 13:19:18 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:19:18 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:19:18 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:19:18 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:19:18 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:19:18 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:19:18 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:19:18 user nova-compute[72019]:       <nova:owner>
Apr 14 13:19:18 user nova-compute[72019]:         <nova:user uuid="65812c6559684eddbdde33cd64ca1fba">tempest-AttachVolumeNegativeTest-893959880-project-member</nova:user>
Apr 14 13:19:18 user nova-compute[72019]:         <nova:project uuid="6833a69217034c4d85ff10bf8aa2fa5c">tempest-AttachVolumeNegativeTest-893959880</nova:project>
Apr 14 13:19:18 user nova-compute[72019]:       </nova:owner>
Apr 14 13:19:18 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:19:18 user nova-compute[72019]:       <nova:ports>
Apr 14 13:19:18 user nova-compute[72019]:         <nova:port uuid="e4d4e52c-5363-4345-9db1-022e8287c65a">
Apr 14 13:19:18 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 13:19:18 user nova-compute[72019]:         </nova:port>
Apr 14 13:19:18 user nova-compute[72019]:       </nova:ports>
Apr 14 13:19:18 user nova-compute[72019]:     </nova:instance>
Apr 14 13:19:18 user nova-compute[72019]:   </metadata>
Apr 14 13:19:18 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:19:18 user nova-compute[72019]:     <system>
Apr 14 13:19:18 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:19:18 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:19:18 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:19:18 user nova-compute[72019]:       <entry name="serial">dca3424c-cbca-4520-a495-8867c2a9c0c4</entry>
Apr 14 13:19:18 user nova-compute[72019]:       <entry name="uuid">dca3424c-cbca-4520-a495-8867c2a9c0c4</entry>
Apr 14 13:19:18 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:19:18 user nova-compute[72019]:     </system>
Apr 14 13:19:18 user nova-compute[72019]:   </sysinfo>
Apr 14 13:19:18 user nova-compute[72019]:   <os>
Apr 14 13:19:18 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:19:18 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:19:18 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:19:18 user nova-compute[72019]:   </os>
Apr 14 13:19:18 user nova-compute[72019]:   <features>
Apr 14 13:19:18 user nova-compute[72019]:     <acpi/>
Apr 14 13:19:18 user nova-compute[72019]:     <apic/>
Apr 14 13:19:18 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:19:18 user nova-compute[72019]:   </features>
Apr 14 13:19:18 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:19:18 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:19:18 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:19:18 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:19:18 user nova-compute[72019]:   </clock>
Apr 14 13:19:18 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:19:18 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:19:18 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:19:18 user nova-compute[72019]:   </cpu>
Apr 14 13:19:18 user nova-compute[72019]:   <devices>
Apr 14 13:19:18 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:19:18 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:19:18 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk"/>
Apr 14 13:19:18 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:19:18 user nova-compute[72019]:     </disk>
Apr 14 13:19:18 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:19:18 user nova-compute[72019]:       <mac address="fa:16:3e:dd:8e:8b"/>
Apr 14 13:19:18 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:19:18 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:19:18 user nova-compute[72019]:       <target dev="tape4d4e52c-53"/>
Apr 14 13:19:18 user nova-compute[72019]:     </interface>
Apr 14 13:19:18 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:19:18 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/console.log" append="off"/>
Apr 14 13:19:18 user nova-compute[72019]:     </serial>
Apr 14 13:19:18 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:19:18 user nova-compute[72019]:     <video>
Apr 14 13:19:18 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:19:18 user nova-compute[72019]:     </video>
Apr 14 13:19:18 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:19:18 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:19:18 user nova-compute[72019]:     </rng>
Apr 14 13:19:18 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:19:18 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:19:18 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:19:18 user nova-compute[72019]:     </memballoon>
Apr 14 13:19:18 user nova-compute[72019]:   </devices>
Apr 14 13:19:18 user nova-compute[72019]: </domain>
Apr 14 13:19:18 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:19:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1960301141',display_name='tempest-AttachVolumeNegativeTest-server-1960301141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1960301141',id=26,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH4IGWPc2G0woSBSu59i2dIWuZuV2nLiEWGcOxBrVeMBfugBK5jZvg3HQO8pKqc4IgnzE7IGw/8/i8zne6vY1fFpHLFViOafQnKXwfPPryecMrr8w+IVET1IuOjpJRNTA==',key_name='tempest-keypair-858857094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6833a69217034c4d85ff10bf8aa2fa5c',ramdisk_id='',reservation_id='r-amlcx4kr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-893959880',owner_user_name='tempest-AttachVolumeNegativeTest-893959880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:19:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65812c6559684eddbdde33cd64ca1fba',uuid=dca3424c-cbca-4520-a495-8867c2a9c0c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4d4e52c-5363-4345-9db1-022e8287c65a", "address": "fa:16:3e:dd:8e:8b", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d4e52c-53", "ovs_interfaceid": "e4d4e52c-5363-4345-9db1-022e8287c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converting VIF {"id": "e4d4e52c-5363-4345-9db1-022e8287c65a", "address": "fa:16:3e:dd:8e:8b", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d4e52c-53", "ovs_interfaceid": "e4d4e52c-5363-4345-9db1-022e8287c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8e:8b,bridge_name='br-int',has_traffic_filtering=True,id=e4d4e52c-5363-4345-9db1-022e8287c65a,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d4e52c-53') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG os_vif [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8e:8b,bridge_name='br-int',has_traffic_filtering=True,id=e4d4e52c-5363-4345-9db1-022e8287c65a,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d4e52c-53') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4d4e52c-53, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4d4e52c-53, col_values=(('external_ids', {'iface-id': 'e4d4e52c-5363-4345-9db1-022e8287c65a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:8e:8b', 'vm-uuid': 'dca3424c-cbca-4520-a495-8867c2a9c0c4'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:18 user nova-compute[72019]: INFO os_vif [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8e:8b,bridge_name='br-int',has_traffic_filtering=True,id=e4d4e52c-5363-4345-9db1-022e8287c65a,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d4e52c-53')
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No VIF found with MAC fa:16:3e:dd:8e:8b, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:18 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Took 0.69 seconds to deallocate network for instance.
Apr 14 13:19:18 user nova-compute[72019]: WARNING nova.volume.cinder [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Attachment b4040deb-7c3f-4f5b-9bd4-c8598a0ba5bf does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b4040deb-7c3f-4f5b-9bd4-c8598a0ba5bf. (HTTP 404) (Request-ID: req-8df4d046-b622-4036-bf60-781952eb1df4)
Apr 14 13:19:18 user nova-compute[72019]: INFO nova.compute.manager [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Took 0.03 seconds to detach 1 volumes for instance.
Apr 14 13:19:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:19 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:19:19 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:19:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:19 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Deleted allocations for instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee
Apr 14 13:19:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.307s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Received event network-changed-e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Refreshing instance network info cache due to event network-changed-e4d4e52c-5363-4345-9db1-022e8287c65a. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:19:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] Acquiring lock "refresh_cache-dca3424c-cbca-4520-a495-8867c2a9c0c4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:19:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] Acquired lock "refresh_cache-dca3424c-cbca-4520-a495-8867c2a9c0c4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:19:19 user nova-compute[72019]: DEBUG nova.network.neutron [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Refreshing network info cache for port e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:19:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:19 user nova-compute[72019]: DEBUG nova.network.neutron [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Updated VIF entry in instance network info cache for port e4d4e52c-5363-4345-9db1-022e8287c65a. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:19:19 user nova-compute[72019]: DEBUG nova.network.neutron [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Updating instance_info_cache with network_info: [{"id": "e4d4e52c-5363-4345-9db1-022e8287c65a", "address": "fa:16:3e:dd:8e:8b", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d4e52c-53", "ovs_interfaceid": "e4d4e52c-5363-4345-9db1-022e8287c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] Releasing lock "refresh_cache-dca3424c-cbca-4520-a495-8867c2a9c0c4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:19:20 user nova-compute[72019]: DEBUG nova.compute.manager [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Received event network-vif-plugged-18490e88-a837-4ac8-a475-885551bb6219 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] Acquiring lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] Lock "2c051c82-e56a-4a50-a24b-23eb2136f3ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:20 user nova-compute[72019]: DEBUG nova.compute.manager [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] No waiting events found dispatching network-vif-plugged-18490e88-a837-4ac8-a475-885551bb6219 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:20 user nova-compute[72019]: WARNING nova.compute.manager [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Received unexpected event network-vif-plugged-18490e88-a837-4ac8-a475-885551bb6219 for instance with vm_state deleted and task_state None.
Apr 14 13:19:20 user nova-compute[72019]: DEBUG nova.compute.manager [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Received event network-vif-deleted-18490e88-a837-4ac8-a475-885551bb6219 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Received event network-vif-plugged-e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] Acquiring lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] No waiting events found dispatching network-vif-plugged-e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:21 user nova-compute[72019]: WARNING nova.compute.manager [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Received unexpected event network-vif-plugged-e4d4e52c-5363-4345-9db1-022e8287c65a for instance with vm_state building and task_state spawning.
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Received event network-vif-plugged-e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] Acquiring lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] No waiting events found dispatching network-vif-plugged-e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:21 user nova-compute[72019]: WARNING nova.compute.manager [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Received unexpected event network-vif-plugged-e4d4e52c-5363-4345-9db1-022e8287c65a for instance with vm_state building and task_state spawning.
Apr 14 13:19:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478361.9612682, dca3424c-cbca-4520-a495-8867c2a9c0c4 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:19:21 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] VM Resumed (Lifecycle Event)
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:19:21 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Instance spawned successfully.
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:19:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:19:22 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:19:22 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478361.9626946, dca3424c-cbca-4520-a495-8867c2a9c0c4 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:19:22 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] VM Started (Lifecycle Event)
Apr 14 13:19:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:19:22 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:19:22 user nova-compute[72019]: INFO nova.compute.manager [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Took 6.34 seconds to spawn the instance on the hypervisor.
Apr 14 13:19:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:22 user nova-compute[72019]: INFO nova.compute.manager [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Took 7.29 seconds to build instance.
Apr 14 13:19:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.416s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:23 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:19:23 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:19:23 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:19:23 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Didn't find any instances for network info cache update. {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 13:19:23 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:19:23 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:19:23 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:19:23 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:19:23 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:19:23 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:19:23 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:19:24 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:19:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:24 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:19:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:24 user nova-compute[72019]: DEBUG nova.objects.instance [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'flavor' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:25 user nova-compute[72019]: INFO nova.compute.manager [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Attaching volume e5cb1d40-77ed-4de5-b20c-c574e4ef2507 to /dev/vdb
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG os_brick.utils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c08a14-fd3a-404f-81f1-8a730e29beee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[115967eb-ad15-4f4e-81eb-2479aee11f5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a9a67f-7229-4b35-904e-e0a925f297bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19543a2-21d2-4eef-8b10-83d548ce6450]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:19:25 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6140356e-53ab-491c-96a3-0ae279ee8546]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG os_brick.utils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Updating existing volume attachment record: da2c1623-075a-4a27-b223-f8fb13928eff {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:29 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:19:29 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7430MB free_disk=26.32232666015625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:19:29 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxdeiubO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:19:30 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:19:30 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:19:30 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e8ba78-6c36-44fc-8586-b102775063e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:19:30 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bce241-ae75-4a80-8c01-7fd48f982175]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507] added
Apr 14 13:19:30 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be95dbd-667b-4060-853d-eed4de512af8]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[36183a33-4063-41a4-9aaf-e991ab4396f4]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxdeiubO {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxdeiubO" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c37071-e5b7-4d27-9570-63c60d9f2ac8]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LxdeiubO'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f7b73-1ead-45ab-8ac3-3d459abe1de8]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecfd294-040f-4b77-9961-a111a52fde21]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 13:19:30 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 13:19:30 user nova-compute[72019]:  {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:19:30 user nova-compute[72019]: WARNING os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 13:19:30 user nova-compute[72019]: 
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeeda11-0ebb-4a78-9515-90300eec4fb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507, portal: 172.16.0.220,3260]
Apr 14 13:19:30 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507, portal: 172.16.0.220,3260] successful.
Apr 14 13:19:30 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b46f467-351d-442e-8e73-31b5491db9f9]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a19259-100a-455c-9266-6817536ddd31]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:19:30 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:19:30 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d630f23f-1ce1-4b15-9c85-18f46d968d00]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:19:30 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxdeiubO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:19:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:19:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26331343735393963', 'path': '/dev/sdb'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:19:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331343735393963', 'path': '/dev/sdb'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:19:31 user nova-compute[72019]: DEBUG nova.objects.instance [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'flavor' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:19:31 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:19:31 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:19:31 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:19:31 user nova-compute[72019]:   <serial>e5cb1d40-77ed-4de5-b20c-c574e4ef2507</serial>
Apr 14 13:19:31 user nova-compute[72019]: </disk>
Apr 14 13:19:31 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:19:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:19:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:19:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] No VIF found with MAC fa:16:3e:79:ac:fd, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:19:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.945s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:32 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478357.7279298, 2c051c82-e56a-4a50-a24b-23eb2136f3ee => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:19:32 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] VM Stopped (Lifecycle Event)
Apr 14 13:19:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c7f2d04c-8eb6-48dd-8eb4-6badc42fd526 None None] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:33 user nova-compute[72019]: INFO nova.compute.manager [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Rescuing
Apr 14 13:19:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:19:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquired lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:19:33 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:19:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:33 user nova-compute[72019]: DEBUG nova.network.neutron [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Updating instance_info_cache with network_info: [{"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Releasing lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:19:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:34 user nova-compute[72019]: DEBUG nova.compute.manager [req-4ba5e9b0-76a4-4d80-a0ee-8e4fab507b84 req-7234512f-7605-458c-bace-5ec0d92c4773 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-vif-unplugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4ba5e9b0-76a4-4d80-a0ee-8e4fab507b84 req-7234512f-7605-458c-bace-5ec0d92c4773 service nova] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4ba5e9b0-76a4-4d80-a0ee-8e4fab507b84 req-7234512f-7605-458c-bace-5ec0d92c4773 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4ba5e9b0-76a4-4d80-a0ee-8e4fab507b84 req-7234512f-7605-458c-bace-5ec0d92c4773 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:34 user nova-compute[72019]: DEBUG nova.compute.manager [req-4ba5e9b0-76a4-4d80-a0ee-8e4fab507b84 req-7234512f-7605-458c-bace-5ec0d92c4773 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] No waiting events found dispatching network-vif-unplugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:34 user nova-compute[72019]: WARNING nova.compute.manager [req-4ba5e9b0-76a4-4d80-a0ee-8e4fab507b84 req-7234512f-7605-458c-bace-5ec0d92c4773 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received unexpected event network-vif-unplugged-965f15ad-1141-41f1-b9f3-41097bb21b5e for instance with vm_state active and task_state rescuing.
Apr 14 13:19:35 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Instance destroyed successfully.
Apr 14 13:19:35 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Attempting a stable device rescue
Apr 14 13:19:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72019) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 13:19:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Instance directory exists: not creating {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 13:19:35 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Creating image(s)
Apr 14 13:19:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "/opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "/opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "/opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:35 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'trusted_certs' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "5b5c314f6d278d6d7ce7cb153dcc5682a46c3093" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "5b5c314f6d278d6d7ce7cb153dcc5682a46c3093" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5c314f6d278d6d7ce7cb153dcc5682a46c3093.part --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5c314f6d278d6d7ce7cb153dcc5682a46c3093.part --force-share --output=json" returned: 0 in 0.186s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:36 user nova-compute[72019]: DEBUG nova.virt.images [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 2bbf35e4-1378-46df-84f2-f839983f7fd6 was qcow2, converting to raw {{(pid=72019) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 13:19:36 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:19:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b5c314f6d278d6d7ce7cb153dcc5682a46c3093.part /opt/stack/data/nova/instances/_base/5b5c314f6d278d6d7ce7cb153dcc5682a46c3093.converted {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-cd865192-280f-4a20-b29c-552cab74d409 req-0e2378ac-f953-467a-b134-da0f57903221 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cd865192-280f-4a20-b29c-552cab74d409 req-0e2378ac-f953-467a-b134-da0f57903221 service nova] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cd865192-280f-4a20-b29c-552cab74d409 req-0e2378ac-f953-467a-b134-da0f57903221 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cd865192-280f-4a20-b29c-552cab74d409 req-0e2378ac-f953-467a-b134-da0f57903221 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-cd865192-280f-4a20-b29c-552cab74d409 req-0e2378ac-f953-467a-b134-da0f57903221 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] No waiting events found dispatching network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:36 user nova-compute[72019]: WARNING nova.compute.manager [req-cd865192-280f-4a20-b29c-552cab74d409 req-0e2378ac-f953-467a-b134-da0f57903221 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received unexpected event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e for instance with vm_state active and task_state rescuing.
Apr 14 13:19:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b5c314f6d278d6d7ce7cb153dcc5682a46c3093.part /opt/stack/data/nova/instances/_base/5b5c314f6d278d6d7ce7cb153dcc5682a46c3093.converted" returned: 0 in 0.602s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5c314f6d278d6d7ce7cb153dcc5682a46c3093.converted --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.compute.manager [req-906e395e-13d7-480f-b86a-9fc5f690ad05 req-5675d29a-aac1-4011-90d6-275aacc9c879 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-changed-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.compute.manager [req-906e395e-13d7-480f-b86a-9fc5f690ad05 req-5675d29a-aac1-4011-90d6-275aacc9c879 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Refreshing instance network info cache due to event network-changed-351008cc-2fb2-4fa8-997d-96ea40263d9d. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-906e395e-13d7-480f-b86a-9fc5f690ad05 req-5675d29a-aac1-4011-90d6-275aacc9c879 service nova] Acquiring lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-906e395e-13d7-480f-b86a-9fc5f690ad05 req-5675d29a-aac1-4011-90d6-275aacc9c879 service nova] Acquired lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.network.neutron [req-906e395e-13d7-480f-b86a-9fc5f690ad05 req-5675d29a-aac1-4011-90d6-275aacc9c879 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Refreshing network info cache for port 351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5c314f6d278d6d7ce7cb153dcc5682a46c3093.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "5b5c314f6d278d6d7ce7cb153dcc5682a46c3093" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.153s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "5b5c314f6d278d6d7ce7cb153dcc5682a46c3093" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "5b5c314f6d278d6d7ce7cb153dcc5682a46c3093" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5c314f6d278d6d7ce7cb153dcc5682a46c3093 --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5c314f6d278d6d7ce7cb153dcc5682a46c3093 --force-share --output=json" returned: 0 in 0.175s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5c314f6d278d6d7ce7cb153dcc5682a46c3093,backing_fmt=raw /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk.rescue {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5c314f6d278d6d7ce7cb153dcc5682a46c3093,backing_fmt=raw /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk.rescue" returned: 0 in 0.063s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "5b5c314f6d278d6d7ce7cb153dcc5682a46c3093" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'migration_context' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Start _get_guest_xml network_info=[{"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "vif_mac": "fa:16:3e:79:ac:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2bbf35e4-1378-46df-84f2-f839983f7fd6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'da2c1623-075a-4a27-b223-f8fb13928eff', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxdeiubO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '65e98ad1-3573-4dce-b9de-bbb1c36ed02e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5cb1d40-77ed-4de5-b20c-c574e4ef2507', 'serial': 'e5cb1d40-77ed-4de5-b20c-c574e4ef2507'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'resources' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'numa_topology' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:37 user nova-compute[72019]: INFO nova.compute.manager [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Terminating instance
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:19:37 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:19:37 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'vcpu_model' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxdeiubO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:19:37 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:19:37 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:19:37 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[70deb938-2391-4cfa-9b49-7dfbb8e3e1c3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LxdeiubO\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 13:19:37 user nova-compute[72019]: node.name = iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507
Apr 14 13:19:37 user nova-compute[72019]: node.tpgt = -1
Apr 14 13:19:37 user nova-compute[72019]: node.startup = automatic
Apr 14 13:19:37 user nova-compute[72019]: node.leading_login = No
Apr 14 13:19:37 user nova-compute[72019]: iface.iscsi_ifacename = default
Apr 14 13:19:37 user nova-compute[72019]: iface.net_ifacename = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.ipaddress = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.prefix_len = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.hwaddress = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.transport_name = tcp
Apr 14 13:19:37 user nova-compute[72019]: iface.initiatorname = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.state = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.vlan_id = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.vlan_priority = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.vlan_state = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.iface_num = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.mtu = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.port = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.bootproto = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.subnet_mask = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.gateway = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.dhcp_alt_client_id = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.dhcp_dns = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.dhcp_learn_iqn = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.dhcp_vendor_id_state = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.dhcp_vendor_id = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.dhcp_slp_da = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.fragmentation = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.gratuitous_arp = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.incoming_forwarding = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.tos_state = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.tos = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.ttl = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.delayed_ack = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.tcp_nagle = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.tcp_wsf_state = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.tcp_wsf = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.tcp_timer_scale = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.tcp_timestamp = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.redirect = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.def_task_mgmt_timeout = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.header_digest = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.data_digest = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.immediate_data = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.initial_r2t = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.data_seq_inorder = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.data_pdu_inorder = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.erl = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.max_receive_data_len = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.first_burst_len = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.max_outstanding_r2t = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.max_burst_len = 0
Apr 14 13:19:37 user nova-compute[72019]: iface.chap_auth = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.bidi_chap = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.strict_login_compliance = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.discovery_auth = <empty>
Apr 14 13:19:37 user nova-compute[72019]: iface.discovery_logout = <empty>
Apr 14 13:19:37 user nova-compute[72019]: node.discovery_address = <empty>
Apr 14 13:19:37 user nova-compute[72019]: node.discovery_port = 0
Apr 14 13:19:37 user nova-compute[72019]: node.discovery_type = static
Apr 14 13:19:37 user nova-compute[72019]: node.session.initial_cmdsn = 0
Apr 14 13:19:37 user nova-compute[72019]: node.session.initial_login_retry_max = 8
Apr 14 13:19:37 user nova-compute[72019]: node.session.xmit_thread_priority = -20
Apr 14 13:19:37 user nova-compute[72019]: node.session.cmds_max = 128
Apr 14 13:19:37 user nova-compute[72019]: node.session.queue_depth = 32
Apr 14 13:19:37 user nova-compute[72019]: node.session.nr_sessions = 1
Apr 14 13:19:37 user nova-compute[72019]: node.session.auth.authmethod = CHAP
Apr 14 13:19:37 user nova-compute[72019]: node.session.auth.username = LxdeiubO
Apr 14 13:19:37 user nova-compute[72019]: node.session.auth.password = ***
Apr 14 13:19:37 user nova-compute[72019]: node.session.auth.username_in = <empty>
Apr 14 13:19:37 user nova-compute[72019]: node.session.auth.password_in = <empty>
Apr 14 13:19:37 user nova-compute[72019]: node.session.auth.chap_algs = MD5
Apr 14 13:19:37 user nova-compute[72019]: node.session.timeo.replacement_timeout = 120
Apr 14 13:19:37 user nova-compute[72019]: node.session.err_timeo.abort_timeout = 15
Apr 14 13:19:37 user nova-compute[72019]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 13:19:37 user nova-compute[72019]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 13:19:37 user nova-compute[72019]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 13:19:37 user nova-compute[72019]: node.session.iscsi.FastAbort = Yes
Apr 14 13:19:37 user nova-compute[72019]: node.session.iscsi.InitialR2T = No
Apr 14 13:19:37 user nova-compute[72019]: node.session.iscsi.ImmediateData = Yes
Apr 14 13:19:37 user nova-compute[72019]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 13:19:37 user nova-compute[72019]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 13:19:37 user nova-compute[72019]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 13:19:37 user nova-compute[72019]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 13:19:37 user nova-compute[72019]: node.session.iscsi.MaxConnections = 1
Apr 14 13:19:37 user nova-compute[72019]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 13:19:37 user nova-compute[72019]: node.session.iscsi.ERL = 0
Apr 14 13:19:37 user nova-compute[72019]: node.session.scan = manual
Apr 14 13:19:37 user nova-compute[72019]: node.session.reopen_max = 0
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].address = 172.16.0.220
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].port = 3260
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].startup = manual
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].tcp.window_size = 524288
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].tcp.type_of_service = 0
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].timeo.logout_timeout = 15
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].timeo.login_timeout = 15
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].timeo.auth_timeout = 45
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].iscsi.DataDigest = None
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].iscsi.IFMarker = No
Apr 14 13:19:37 user nova-compute[72019]: node.conn[0].iscsi.OFMarker = No
Apr 14 13:19:37 user nova-compute[72019]: # END RECORD
Apr 14 13:19:37 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5bf0e1-f795-4304-8b7a-a2a4f53c7d20]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0795583d-9794-431c-b960-01ade06d7423]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxdeiubO {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxdeiubO" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b43be2-8dd5-4230-9860-682aa1bd18ae]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LxdeiubO'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7d7f50-51cc-4d14-b4e4-455c1a075706]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedb5fdd-b307-458b-be77-23938119ef89]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:19:37 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:19:37 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.213s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] HCTL ('33', '0', '0', 0) found on session 21 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ed3491-50f5-48e4-9878-21ac8f3eb53b]: (4, ('0 0 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Searching for a device in session 21 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxdeiubO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.244s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] <== connect_volume: return (246ms) {'type': 'block', 'scsi_wwn': '26331343735393963', 'path': '/dev/sdb'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331343735393963', 'path': '/dev/sdb'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-450055877',display_name='tempest-ServerStableDeviceRescueTest-server-450055877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-450055877',id=15,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjseCXo591Ib7m2QQg2YUiEmBpT41KO6pBZujMk3kb1ezcLxBJnhodHUloea6z3H0OhTIU/PPnS5Viw3M1jYSulnA0hMkrnmWEGu58Pu2ctSWI3CS0ih18sa0sVBubY/Q==',key_name='tempest-keypair-1253237269',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:15:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76b733f664b340e289c562e19ebd28c3',ramdisk_id='',reservation_id='r-t3f59y77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-583958040',owner_user_name='tempest-ServerStableDeviceRescueTest-583958040-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='065f23d461f44751a6911adcd3124fe9',uuid=65e98ad1-3573-4dce-b9de-bbb1c36ed02e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "vif_mac": "fa:16:3e:79:ac:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Converting VIF {"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "vif_mac": "fa:16:3e:79:ac:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=965f15ad-1141-41f1-b9f3-41097bb21b5e,network=Network(1791e209-7b0c-4262-a342-ed1523633f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965f15ad-11') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:19:37 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'pci_devices' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.network.neutron [req-906e395e-13d7-480f-b86a-9fc5f690ad05 req-5675d29a-aac1-4011-90d6-275aacc9c879 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updated VIF entry in instance network info cache for port 351008cc-2fb2-4fa8-997d-96ea40263d9d. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.network.neutron [req-906e395e-13d7-480f-b86a-9fc5f690ad05 req-5675d29a-aac1-4011-90d6-275aacc9c879 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updating instance_info_cache with network_info: [{"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:19:38 user nova-compute[72019]:   <uuid>65e98ad1-3573-4dce-b9de-bbb1c36ed02e</uuid>
Apr 14 13:19:38 user nova-compute[72019]:   <name>instance-0000000f</name>
Apr 14 13:19:38 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:19:38 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:19:38 user nova-compute[72019]:   <metadata>
Apr 14 13:19:38 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:19:38 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:19:38 user nova-compute[72019]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-450055877</nova:name>
Apr 14 13:19:38 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:19:37</nova:creationTime>
Apr 14 13:19:38 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:19:38 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:19:38 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:19:38 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:19:38 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:19:38 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:19:38 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:19:38 user nova-compute[72019]:       <nova:owner>
Apr 14 13:19:38 user nova-compute[72019]:         <nova:user uuid="065f23d461f44751a6911adcd3124fe9">tempest-ServerStableDeviceRescueTest-583958040-project-member</nova:user>
Apr 14 13:19:38 user nova-compute[72019]:         <nova:project uuid="76b733f664b340e289c562e19ebd28c3">tempest-ServerStableDeviceRescueTest-583958040</nova:project>
Apr 14 13:19:38 user nova-compute[72019]:       </nova:owner>
Apr 14 13:19:38 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:19:38 user nova-compute[72019]:       <nova:ports>
Apr 14 13:19:38 user nova-compute[72019]:         <nova:port uuid="965f15ad-1141-41f1-b9f3-41097bb21b5e">
Apr 14 13:19:38 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 13:19:38 user nova-compute[72019]:         </nova:port>
Apr 14 13:19:38 user nova-compute[72019]:       </nova:ports>
Apr 14 13:19:38 user nova-compute[72019]:     </nova:instance>
Apr 14 13:19:38 user nova-compute[72019]:   </metadata>
Apr 14 13:19:38 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:19:38 user nova-compute[72019]:     <system>
Apr 14 13:19:38 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:19:38 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:19:38 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:19:38 user nova-compute[72019]:       <entry name="serial">65e98ad1-3573-4dce-b9de-bbb1c36ed02e</entry>
Apr 14 13:19:38 user nova-compute[72019]:       <entry name="uuid">65e98ad1-3573-4dce-b9de-bbb1c36ed02e</entry>
Apr 14 13:19:38 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:19:38 user nova-compute[72019]:     </system>
Apr 14 13:19:38 user nova-compute[72019]:   </sysinfo>
Apr 14 13:19:38 user nova-compute[72019]:   <os>
Apr 14 13:19:38 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:19:38 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:19:38 user nova-compute[72019]:   </os>
Apr 14 13:19:38 user nova-compute[72019]:   <features>
Apr 14 13:19:38 user nova-compute[72019]:     <acpi/>
Apr 14 13:19:38 user nova-compute[72019]:     <apic/>
Apr 14 13:19:38 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:19:38 user nova-compute[72019]:   </features>
Apr 14 13:19:38 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:19:38 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:19:38 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:19:38 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:19:38 user nova-compute[72019]:   </clock>
Apr 14 13:19:38 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:19:38 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:19:38 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:19:38 user nova-compute[72019]:   </cpu>
Apr 14 13:19:38 user nova-compute[72019]:   <devices>
Apr 14 13:19:38 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:19:38 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:19:38 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk"/>
Apr 14 13:19:38 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:19:38 user nova-compute[72019]:     </disk>
Apr 14 13:19:38 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:19:38 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:19:38 user nova-compute[72019]:       <source dev="/dev/sdb"/>
Apr 14 13:19:38 user nova-compute[72019]:       <target dev="vdb" bus="virtio"/>
Apr 14 13:19:38 user nova-compute[72019]:       <serial>e5cb1d40-77ed-4de5-b20c-c574e4ef2507</serial>
Apr 14 13:19:38 user nova-compute[72019]:     </disk>
Apr 14 13:19:38 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:19:38 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:19:38 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk.rescue"/>
Apr 14 13:19:38 user nova-compute[72019]:       <target dev="vdc" bus="virtio"/>
Apr 14 13:19:38 user nova-compute[72019]:       <boot order="1"/>
Apr 14 13:19:38 user nova-compute[72019]:     </disk>
Apr 14 13:19:38 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:19:38 user nova-compute[72019]:       <mac address="fa:16:3e:79:ac:fd"/>
Apr 14 13:19:38 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:19:38 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:19:38 user nova-compute[72019]:       <target dev="tap965f15ad-11"/>
Apr 14 13:19:38 user nova-compute[72019]:     </interface>
Apr 14 13:19:38 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:19:38 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/console.log" append="off"/>
Apr 14 13:19:38 user nova-compute[72019]:     </serial>
Apr 14 13:19:38 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:19:38 user nova-compute[72019]:     <video>
Apr 14 13:19:38 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:19:38 user nova-compute[72019]:     </video>
Apr 14 13:19:38 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:19:38 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:19:38 user nova-compute[72019]:     </rng>
Apr 14 13:19:38 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:19:38 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:19:38 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:19:38 user nova-compute[72019]:     </memballoon>
Apr 14 13:19:38 user nova-compute[72019]:   </devices>
Apr 14 13:19:38 user nova-compute[72019]: </domain>
Apr 14 13:19:38 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-906e395e-13d7-480f-b86a-9fc5f690ad05 req-5675d29a-aac1-4011-90d6-275aacc9c879 service nova] Releasing lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.compute.manager [req-5c329bfd-fc0e-4301-b564-8cb9bbc0d1ec req-c3e4e62f-1146-4cde-85d6-12da60db3466 service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Received event network-vif-unplugged-697153ca-2b37-46af-a0d3-7624fea31022 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5c329bfd-fc0e-4301-b564-8cb9bbc0d1ec req-c3e4e62f-1146-4cde-85d6-12da60db3466 service nova] Acquiring lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5c329bfd-fc0e-4301-b564-8cb9bbc0d1ec req-c3e4e62f-1146-4cde-85d6-12da60db3466 service nova] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5c329bfd-fc0e-4301-b564-8cb9bbc0d1ec req-c3e4e62f-1146-4cde-85d6-12da60db3466 service nova] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.compute.manager [req-5c329bfd-fc0e-4301-b564-8cb9bbc0d1ec req-c3e4e62f-1146-4cde-85d6-12da60db3466 service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] No waiting events found dispatching network-vif-unplugged-697153ca-2b37-46af-a0d3-7624fea31022 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.compute.manager [req-5c329bfd-fc0e-4301-b564-8cb9bbc0d1ec req-c3e4e62f-1146-4cde-85d6-12da60db3466 service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Received event network-vif-unplugged-697153ca-2b37-46af-a0d3-7624fea31022 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:19:38 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Instance destroyed successfully.
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] No VIF found with MAC fa:16:3e:79:ac:fd, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:38 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Instance destroyed successfully.
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lazy-loading 'resources' on Instance uuid 7c9e5ef7-70a6-449b-bc05-ff1d80465754 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1701137510',display_name='tempest-VolumesActionsTest-instance-1701137510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1701137510',id=22,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:17:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50c008548ed42bbaffac5876989b3a0',ramdisk_id='',reservation_id='r-zwa006yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2460432',owner_user_name='tempest-VolumesActionsTest-2460432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:17:48Z,user_data=None,user_id='2272cf2bf2f148e59dd600921894bb65',uuid=7c9e5ef7-70a6-449b-bc05-ff1d80465754,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "697153ca-2b37-46af-a0d3-7624fea31022", "address": "fa:16:3e:ef:01:cc", "network": {"id": "be533313-1783-4791-b33f-7b13e2201700", "bridge": "br-int", "label": "tempest-VolumesActionsTest-111134217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e50c008548ed42bbaffac5876989b3a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697153ca-2b", "ovs_interfaceid": "697153ca-2b37-46af-a0d3-7624fea31022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Converting VIF {"id": "697153ca-2b37-46af-a0d3-7624fea31022", "address": "fa:16:3e:ef:01:cc", "network": {"id": "be533313-1783-4791-b33f-7b13e2201700", "bridge": "br-int", "label": "tempest-VolumesActionsTest-111134217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e50c008548ed42bbaffac5876989b3a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697153ca-2b", "ovs_interfaceid": "697153ca-2b37-46af-a0d3-7624fea31022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:01:cc,bridge_name='br-int',has_traffic_filtering=True,id=697153ca-2b37-46af-a0d3-7624fea31022,network=Network(be533313-1783-4791-b33f-7b13e2201700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697153ca-2b') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG os_vif [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:01:cc,bridge_name='br-int',has_traffic_filtering=True,id=697153ca-2b37-46af-a0d3-7624fea31022,network=Network(be533313-1783-4791-b33f-7b13e2201700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697153ca-2b') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap697153ca-2b, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:38 user nova-compute[72019]: INFO os_vif [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:01:cc,bridge_name='br-int',has_traffic_filtering=True,id=697153ca-2b37-46af-a0d3-7624fea31022,network=Network(be533313-1783-4791-b33f-7b13e2201700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697153ca-2b')
Apr 14 13:19:38 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Deleting instance files /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754_del
Apr 14 13:19:38 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Deletion of /opt/stack/data/nova/instances/7c9e5ef7-70a6-449b-bc05-ff1d80465754_del complete
Apr 14 13:19:38 user nova-compute[72019]: INFO nova.compute.manager [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 14 13:19:38 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:19:38 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:19:39 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-38dec9db-e085-4eaf-8a54-b929eb8acc58 req-5d7d8971-a56f-40c0-843c-75833ac9e18f service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Received event network-vif-deleted-697153ca-2b37-46af-a0d3-7624fea31022 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:39 user nova-compute[72019]: INFO nova.compute.manager [req-38dec9db-e085-4eaf-8a54-b929eb8acc58 req-5d7d8971-a56f-40c0-843c-75833ac9e18f service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Neutron deleted interface 697153ca-2b37-46af-a0d3-7624fea31022; detaching it from the instance and deleting it from the info cache
Apr 14 13:19:39 user nova-compute[72019]: DEBUG nova.network.neutron [req-38dec9db-e085-4eaf-8a54-b929eb8acc58 req-5d7d8971-a56f-40c0-843c-75833ac9e18f service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:39 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Took 0.69 seconds to deallocate network for instance.
Apr 14 13:19:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-38dec9db-e085-4eaf-8a54-b929eb8acc58 req-5d7d8971-a56f-40c0-843c-75833ac9e18f service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Detach interface failed, port_id=697153ca-2b37-46af-a0d3-7624fea31022, reason: Instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:19:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:39 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:19:39 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:19:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:40 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Deleted allocations for instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754
Apr 14 13:19:40 user nova-compute[72019]: DEBUG nova.compute.manager [req-8aeaaed3-ebf0-44cc-a040-b64bbdc526b0 req-d797bcc7-9b0c-4c3f-8e61-04b3bd5206be service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Received event network-vif-plugged-697153ca-2b37-46af-a0d3-7624fea31022 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8aeaaed3-ebf0-44cc-a040-b64bbdc526b0 req-d797bcc7-9b0c-4c3f-8e61-04b3bd5206be service nova] Acquiring lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8aeaaed3-ebf0-44cc-a040-b64bbdc526b0 req-d797bcc7-9b0c-4c3f-8e61-04b3bd5206be service nova] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8aeaaed3-ebf0-44cc-a040-b64bbdc526b0 req-d797bcc7-9b0c-4c3f-8e61-04b3bd5206be service nova] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:40 user nova-compute[72019]: DEBUG nova.compute.manager [req-8aeaaed3-ebf0-44cc-a040-b64bbdc526b0 req-d797bcc7-9b0c-4c3f-8e61-04b3bd5206be service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] No waiting events found dispatching network-vif-plugged-697153ca-2b37-46af-a0d3-7624fea31022 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:40 user nova-compute[72019]: WARNING nova.compute.manager [req-8aeaaed3-ebf0-44cc-a040-b64bbdc526b0 req-d797bcc7-9b0c-4c3f-8e61-04b3bd5206be service nova] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Received unexpected event network-vif-plugged-697153ca-2b37-46af-a0d3-7624fea31022 for instance with vm_state deleted and task_state None.
Apr 14 13:19:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "7c9e5ef7-70a6-449b-bc05-ff1d80465754" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.511s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:40 user nova-compute[72019]: DEBUG nova.compute.manager [req-4004f86c-2f78-4603-b4f1-ddf5f13853e4 req-4ee748c3-2cf8-4976-9b47-74e7f5cc846e service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4004f86c-2f78-4603-b4f1-ddf5f13853e4 req-4ee748c3-2cf8-4976-9b47-74e7f5cc846e service nova] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4004f86c-2f78-4603-b4f1-ddf5f13853e4 req-4ee748c3-2cf8-4976-9b47-74e7f5cc846e service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4004f86c-2f78-4603-b4f1-ddf5f13853e4 req-4ee748c3-2cf8-4976-9b47-74e7f5cc846e service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:40 user nova-compute[72019]: DEBUG nova.compute.manager [req-4004f86c-2f78-4603-b4f1-ddf5f13853e4 req-4ee748c3-2cf8-4976-9b47-74e7f5cc846e service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] No waiting events found dispatching network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:40 user nova-compute[72019]: WARNING nova.compute.manager [req-4004f86c-2f78-4603-b4f1-ddf5f13853e4 req-4ee748c3-2cf8-4976-9b47-74e7f5cc846e service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received unexpected event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e for instance with vm_state active and task_state rescuing.
Apr 14 13:19:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:41 user nova-compute[72019]: INFO nova.compute.manager [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Shelving
Apr 14 13:19:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:42 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Instance destroyed successfully.
Apr 14 13:19:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for 65e98ad1-3573-4dce-b9de-bbb1c36ed02e due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:19:42 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478382.1064496, 65e98ad1-3573-4dce-b9de-bbb1c36ed02e => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:19:42 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] VM Resumed (Lifecycle Event)
Apr 14 13:19:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:19:42 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 13:19:42 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478382.1095636, 65e98ad1-3573-4dce-b9de-bbb1c36ed02e => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:19:42 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] VM Started (Lifecycle Event)
Apr 14 13:19:42 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Beginning cold snapshot process
Apr 14 13:19:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:19:42 user nova-compute[72019]: DEBUG nova.compute.manager [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:42 user nova-compute[72019]: DEBUG nova.compute.manager [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] No waiting events found dispatching network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:42 user nova-compute[72019]: WARNING nova.compute.manager [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received unexpected event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e for instance with vm_state rescued and task_state None.
Apr 14 13:19:42 user nova-compute[72019]: DEBUG nova.compute.manager [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-vif-unplugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:42 user nova-compute[72019]: DEBUG nova.compute.manager [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] No waiting events found dispatching network-vif-unplugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:42 user nova-compute[72019]: WARNING nova.compute.manager [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received unexpected event network-vif-unplugged-351008cc-2fb2-4fa8-997d-96ea40263d9d for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 13:19:42 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:19:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk /opt/stack/data/nova/instances/snapshots/tmpfvp57e3p/3fcc1c2e46fb41798a9818bf21b3f879 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk /opt/stack/data/nova/instances/snapshots/tmpfvp57e3p/3fcc1c2e46fb41798a9818bf21b3f879" returned: 0 in 0.748s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:43 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Snapshot extracted, beginning image upload
Apr 14 13:19:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:44 user nova-compute[72019]: DEBUG nova.compute.manager [req-d39f8708-afad-43e1-a5b2-7eb9bc50aee9 req-a504e603-dd63-4212-ab8b-c85287a005ff service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d39f8708-afad-43e1-a5b2-7eb9bc50aee9 req-a504e603-dd63-4212-ab8b-c85287a005ff service nova] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d39f8708-afad-43e1-a5b2-7eb9bc50aee9 req-a504e603-dd63-4212-ab8b-c85287a005ff service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d39f8708-afad-43e1-a5b2-7eb9bc50aee9 req-a504e603-dd63-4212-ab8b-c85287a005ff service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:44 user nova-compute[72019]: DEBUG nova.compute.manager [req-d39f8708-afad-43e1-a5b2-7eb9bc50aee9 req-a504e603-dd63-4212-ab8b-c85287a005ff service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] No waiting events found dispatching network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:19:44 user nova-compute[72019]: WARNING nova.compute.manager [req-d39f8708-afad-43e1-a5b2-7eb9bc50aee9 req-a504e603-dd63-4212-ab8b-c85287a005ff service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received unexpected event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 13:19:45 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Snapshot image upload complete
Apr 14 13:19:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:45 user nova-compute[72019]: INFO nova.compute.manager [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Shelve offloading
Apr 14 13:19:45 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Instance destroyed successfully.
Apr 14 13:19:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:19:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquired lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:19:45 user nova-compute[72019]: DEBUG nova.network.neutron [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:19:46 user nova-compute[72019]: DEBUG nova.network.neutron [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updating instance_info_cache with network_info: [{"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Releasing lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:19:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "b7cdf352-a517-4296-bc70-400836915095" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:19:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:46 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:19:46 user nova-compute[72019]: INFO nova.compute.claims [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Claim successful on node user
Apr 14 13:19:47 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Instance destroyed successfully.
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'resources' on Instance uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2054124847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2054124847',id=23,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe8+NQxdd30Id654GBmcPwxA0JUpEg+Hy4COx6Fb893eVwtn8PELZv6pRPgbhjQTvkkY11PVtxzwFy1OaWZde1spOAQMgX1ADyyiK3GMyy+wZuqUsAbmtL2UTWG2YF/Rg==',key_name='tempest-keypair-1859762998',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:17:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8f0fee50983a4e31b1689dc77b1c4db1',ramdisk_id='',reservation_id='r-bh3fqraz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1344633518',owner_user_name='tempest-AttachVolumeShelveTestJSON-1344633518-project-member',shelved_at='2023-04-14T13:19:45.515272',shelved_host='user',shelved_image_id='38ad7f16-bf0d-4451-8988-65cefed93769'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:19:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04370605aec40a0a53a080c1e8bf8a8',uuid=1a866f3f-b709-4286-8cef-8e3b35f26d0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converting VIF {"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:74:1b,bridge_name='br-int',has_traffic_filtering=True,id=351008cc-2fb2-4fa8-997d-96ea40263d9d,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351008cc-2f') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG os_vif [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:74:1b,bridge_name='br-int',has_traffic_filtering=True,id=351008cc-2fb2-4fa8-997d-96ea40263d9d,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351008cc-2f') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap351008cc-2f, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-dd17ccb8-c31b-47dc-86a7-ef9451450d60 req-be51404c-0783-40cf-8829-cf81fc6c5b12 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-changed-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-dd17ccb8-c31b-47dc-86a7-ef9451450d60 req-be51404c-0783-40cf-8829-cf81fc6c5b12 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Refreshing instance network info cache due to event network-changed-351008cc-2fb2-4fa8-997d-96ea40263d9d. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dd17ccb8-c31b-47dc-86a7-ef9451450d60 req-be51404c-0783-40cf-8829-cf81fc6c5b12 service nova] Acquiring lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dd17ccb8-c31b-47dc-86a7-ef9451450d60 req-be51404c-0783-40cf-8829-cf81fc6c5b12 service nova] Acquired lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.network.neutron [req-dd17ccb8-c31b-47dc-86a7-ef9451450d60 req-be51404c-0783-40cf-8829-cf81fc6c5b12 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Refreshing network info cache for port 351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:19:47 user nova-compute[72019]: INFO os_vif [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:74:1b,bridge_name='br-int',has_traffic_filtering=True,id=351008cc-2fb2-4fa8-997d-96ea40263d9d,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351008cc-2f')
Apr 14 13:19:47 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Deleting instance files /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b_del
Apr 14 13:19:47 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Deletion of /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b_del complete
Apr 14 13:19:47 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Deleted allocations for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b
Apr 14 13:19:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.171s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'numa_topology' on Instance uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:19:47 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:19:47 user nova-compute[72019]: INFO nova.virt.block_device [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Booting with blank volume at /dev/vda
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.511s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-dd17ccb8-c31b-47dc-86a7-ef9451450d60 req-be51404c-0783-40cf-8829-cf81fc6c5b12 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updated VIF entry in instance network info cache for port 351008cc-2fb2-4fa8-997d-96ea40263d9d. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:19:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-dd17ccb8-c31b-47dc-86a7-ef9451450d60 req-be51404c-0783-40cf-8829-cf81fc6c5b12 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updating instance_info_cache with network_info: [{"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap351008cc-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:48 user nova-compute[72019]: DEBUG nova.policy [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:19:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dd17ccb8-c31b-47dc-86a7-ef9451450d60 req-be51404c-0783-40cf-8829-cf81fc6c5b12 service nova] Releasing lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:19:48 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Successfully created port: c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:19:49 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Successfully updated port: c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:19:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:19:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquired lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:19:49 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:19:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d56a9fe-d467-4cd4-8694-426a5f2cac74 req-eaed4876-250d-4e45-85a9-6e271eecdd5d service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-changed-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:19:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-4d56a9fe-d467-4cd4-8694-426a5f2cac74 req-eaed4876-250d-4e45-85a9-6e271eecdd5d service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Refreshing instance network info cache due to event network-changed-c5258996-381d-45a2-8447-784b03a4e32e. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:19:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d56a9fe-d467-4cd4-8694-426a5f2cac74 req-eaed4876-250d-4e45-85a9-6e271eecdd5d service nova] Acquiring lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:19:49 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:19:49 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Updating instance_info_cache with network_info: [{"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Releasing lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:19:49 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Instance network_info: |[{"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:19:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d56a9fe-d467-4cd4-8694-426a5f2cac74 req-eaed4876-250d-4e45-85a9-6e271eecdd5d service nova] Acquired lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:19:49 user nova-compute[72019]: DEBUG nova.network.neutron [req-4d56a9fe-d467-4cd4-8694-426a5f2cac74 req-eaed4876-250d-4e45-85a9-6e271eecdd5d service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Refreshing network info cache for port c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:19:50 user nova-compute[72019]: DEBUG nova.network.neutron [req-4d56a9fe-d467-4cd4-8694-426a5f2cac74 req-eaed4876-250d-4e45-85a9-6e271eecdd5d service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Updated VIF entry in instance network info cache for port c5258996-381d-45a2-8447-784b03a4e32e. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:19:50 user nova-compute[72019]: DEBUG nova.network.neutron [req-4d56a9fe-d467-4cd4-8694-426a5f2cac74 req-eaed4876-250d-4e45-85a9-6e271eecdd5d service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Updating instance_info_cache with network_info: [{"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:19:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4d56a9fe-d467-4cd4-8694-426a5f2cac74 req-eaed4876-250d-4e45-85a9-6e271eecdd5d service nova] Releasing lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:19:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG os_brick.utils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[285309ee-8c7d-4111-b101-74b1edc98ff8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62a58ca-41a2-4b1f-a955-dc3478c5f7b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e8e849-586d-41cd-8f17-03d5c8a4ef72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da49d0c-e613-427d-b606-956c285679b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:19:53 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:19:53 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a803433-2874-490b-b333-c3689bd00087]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG os_brick.utils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Updating existing volume attachment record: 6e3b6e3e-9801-4c8e-8753-9def5a5821a6 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:19:53 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478378.6028092, 7c9e5ef7-70a6-449b-bc05-ff1d80465754 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:19:53 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] VM Stopped (Lifecycle Event)
Apr 14 13:19:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-2a142b11-d491-4edb-8f23-dbe8b674eda7 None None] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478382.0894084, 1a866f3f-b709-4286-8cef-8e3b35f26d0b => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:19:57 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] VM Stopped (Lifecycle Event)
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e7cb1102-cbe7-4b19-ac37-172b72387ae7 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:19:57 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Creating image(s)
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Ensure instance console log exists: /opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Start _get_guest_xml network_info=[{"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '6e3b6e3e-9801-4c8e-8753-9def5a5821a6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJSeHZPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b7cdf352-a517-4296-bc70-400836915095', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa0a3b39-55d0-49c4-b1db-4792d0f556d6', 'serial': 'fa0a3b39-55d0-49c4-b1db-4792d0f556d6'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:19:57 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:19:57 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:19:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJSeHZPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:19:57 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:19:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:19:58 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:19:58 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f048ef-c6d6-4d8b-9346-3cf5bc0370cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:19:58 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb8d2da-1409-4d38-b803-e2b77da0add4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6] added
Apr 14 13:19:58 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e58d44a-7f81-4a54-8a06-2375582396c5]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[125fcb25-4446-4282-adfc-816d47c7d35d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OJSeHZPF {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OJSeHZPF" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba13bf3a-47f4-4f0e-a8cc-fc2655bf9601]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OJSeHZPF'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe403306-9d61-46b8-bd58-6132cdc637e3]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e21452a-3dbb-4117-a1b8-49f67f678a1b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:19:58 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:19:58 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d81e81-47cb-48b1-a619-7d8e25d9ffe6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6, portal: 172.16.0.220,3260]
Apr 14 13:19:58 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6, portal: 172.16.0.220,3260] successful.
Apr 14 13:19:58 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[df87d242-6363-4102-806f-e8b1c3c99c3e]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[503eafbc-a750-4fb6-85a0-8041885e4c73]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:19:58 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:19:58 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:19:58 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:19:58 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[59584b58-f85e-4bef-b3b9-172850f47a34]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:19:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJSeHZPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26530623034653063', 'path': '/dev/sdc'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530623034653063', 'path': '/dev/sdc'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1188690873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1188690873',id=27,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a573d19b775642bba2f2883e0005492d',ramdisk_id='',reservation_id='r-rm54dxhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-740277424',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:19:48Z,user_data=None,user_id='ebc2d46bc1794568841df20b046356c7',uuid=b7cdf352-a517-4296-bc70-400836915095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converting VIF {"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:44:e4,bridge_name='br-int',has_traffic_filtering=True,id=c5258996-381d-45a2-8447-784b03a4e32e,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5258996-38') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'pci_devices' on Instance uuid b7cdf352-a517-4296-bc70-400836915095 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:19:59 user nova-compute[72019]:   <uuid>b7cdf352-a517-4296-bc70-400836915095</uuid>
Apr 14 13:19:59 user nova-compute[72019]:   <name>instance-0000001b</name>
Apr 14 13:19:59 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:19:59 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:19:59 user nova-compute[72019]:   <metadata>
Apr 14 13:19:59 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:19:59 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:19:59 user nova-compute[72019]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1188690873</nova:name>
Apr 14 13:19:59 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:19:57</nova:creationTime>
Apr 14 13:19:59 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:19:59 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:19:59 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:19:59 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:19:59 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:19:59 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:19:59 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:19:59 user nova-compute[72019]:       <nova:owner>
Apr 14 13:19:59 user nova-compute[72019]:         <nova:user uuid="ebc2d46bc1794568841df20b046356c7">tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member</nova:user>
Apr 14 13:19:59 user nova-compute[72019]:         <nova:project uuid="a573d19b775642bba2f2883e0005492d">tempest-ServerBootFromVolumeStableRescueTest-740277424</nova:project>
Apr 14 13:19:59 user nova-compute[72019]:       </nova:owner>
Apr 14 13:19:59 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:19:59 user nova-compute[72019]:       <nova:ports>
Apr 14 13:19:59 user nova-compute[72019]:         <nova:port uuid="c5258996-381d-45a2-8447-784b03a4e32e">
Apr 14 13:19:59 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 13:19:59 user nova-compute[72019]:         </nova:port>
Apr 14 13:19:59 user nova-compute[72019]:       </nova:ports>
Apr 14 13:19:59 user nova-compute[72019]:     </nova:instance>
Apr 14 13:19:59 user nova-compute[72019]:   </metadata>
Apr 14 13:19:59 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:19:59 user nova-compute[72019]:     <system>
Apr 14 13:19:59 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:19:59 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:19:59 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:19:59 user nova-compute[72019]:       <entry name="serial">b7cdf352-a517-4296-bc70-400836915095</entry>
Apr 14 13:19:59 user nova-compute[72019]:       <entry name="uuid">b7cdf352-a517-4296-bc70-400836915095</entry>
Apr 14 13:19:59 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:19:59 user nova-compute[72019]:     </system>
Apr 14 13:19:59 user nova-compute[72019]:   </sysinfo>
Apr 14 13:19:59 user nova-compute[72019]:   <os>
Apr 14 13:19:59 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:19:59 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:19:59 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:19:59 user nova-compute[72019]:   </os>
Apr 14 13:19:59 user nova-compute[72019]:   <features>
Apr 14 13:19:59 user nova-compute[72019]:     <acpi/>
Apr 14 13:19:59 user nova-compute[72019]:     <apic/>
Apr 14 13:19:59 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:19:59 user nova-compute[72019]:   </features>
Apr 14 13:19:59 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:19:59 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:19:59 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:19:59 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:19:59 user nova-compute[72019]:   </clock>
Apr 14 13:19:59 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:19:59 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:19:59 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:19:59 user nova-compute[72019]:   </cpu>
Apr 14 13:19:59 user nova-compute[72019]:   <devices>
Apr 14 13:19:59 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:19:59 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:19:59 user nova-compute[72019]:       <source dev="/dev/sdc"/>
Apr 14 13:19:59 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:19:59 user nova-compute[72019]:       <serial>fa0a3b39-55d0-49c4-b1db-4792d0f556d6</serial>
Apr 14 13:19:59 user nova-compute[72019]:     </disk>
Apr 14 13:19:59 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:19:59 user nova-compute[72019]:       <mac address="fa:16:3e:35:44:e4"/>
Apr 14 13:19:59 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:19:59 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:19:59 user nova-compute[72019]:       <target dev="tapc5258996-38"/>
Apr 14 13:19:59 user nova-compute[72019]:     </interface>
Apr 14 13:19:59 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:19:59 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095/console.log" append="off"/>
Apr 14 13:19:59 user nova-compute[72019]:     </serial>
Apr 14 13:19:59 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:19:59 user nova-compute[72019]:     <video>
Apr 14 13:19:59 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:19:59 user nova-compute[72019]:     </video>
Apr 14 13:19:59 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:19:59 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:19:59 user nova-compute[72019]:     </rng>
Apr 14 13:19:59 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:19:59 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:19:59 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:19:59 user nova-compute[72019]:     </memballoon>
Apr 14 13:19:59 user nova-compute[72019]:   </devices>
Apr 14 13:19:59 user nova-compute[72019]: </domain>
Apr 14 13:19:59 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1188690873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1188690873',id=27,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a573d19b775642bba2f2883e0005492d',ramdisk_id='',reservation_id='r-rm54dxhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-740277424',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:19:48Z,user_data=None,user_id='ebc2d46bc1794568841df20b046356c7',uuid=b7cdf352-a517-4296-bc70-400836915095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converting VIF {"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:44:e4,bridge_name='br-int',has_traffic_filtering=True,id=c5258996-381d-45a2-8447-784b03a4e32e,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5258996-38') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG os_vif [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:44:e4,bridge_name='br-int',has_traffic_filtering=True,id=c5258996-381d-45a2-8447-784b03a4e32e,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5258996-38') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5258996-38, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5258996-38, col_values=(('external_ids', {'iface-id': 'c5258996-381d-45a2-8447-784b03a4e32e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:44:e4', 'vm-uuid': 'b7cdf352-a517-4296-bc70-400836915095'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:19:59 user nova-compute[72019]: INFO os_vif [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:44:e4,bridge_name='br-int',has_traffic_filtering=True,id=c5258996-381d-45a2-8447-784b03a4e32e,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5258996-38')
Apr 14 13:19:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:19:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] No VIF found with MAC fa:16:3e:35:44:e4, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:20:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-fb0183e2-b085-44f9-98fc-9a4664f420f5 req-a7178976-060f-4350-a011-598e9f2b7300 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:20:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb0183e2-b085-44f9-98fc-9a4664f420f5 req-a7178976-060f-4350-a011-598e9f2b7300 service nova] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb0183e2-b085-44f9-98fc-9a4664f420f5 req-a7178976-060f-4350-a011-598e9f2b7300 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb0183e2-b085-44f9-98fc-9a4664f420f5 req-a7178976-060f-4350-a011-598e9f2b7300 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-fb0183e2-b085-44f9-98fc-9a4664f420f5 req-a7178976-060f-4350-a011-598e9f2b7300 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] No waiting events found dispatching network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:20:00 user nova-compute[72019]: WARNING nova.compute.manager [req-fb0183e2-b085-44f9-98fc-9a4664f420f5 req-a7178976-060f-4350-a011-598e9f2b7300 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received unexpected event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e for instance with vm_state building and task_state spawning.
Apr 14 13:20:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478402.8745382, b7cdf352-a517-4296-bc70-400836915095 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:20:02 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] VM Resumed (Lifecycle Event)
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:20:02 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: b7cdf352-a517-4296-bc70-400836915095] Instance spawned successfully.
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:20:02 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478402.8760567, b7cdf352-a517-4296-bc70-400836915095 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:20:02 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] VM Started (Lifecycle Event)
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:20:02 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:20:02 user nova-compute[72019]: INFO nova.compute.manager [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Took 5.04 seconds to spawn the instance on the hypervisor.
Apr 14 13:20:02 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:20:03 user nova-compute[72019]: DEBUG nova.compute.manager [req-ec22dbcb-7334-4e84-a120-89869b57bfea req-685540d2-af11-4e32-940f-ecee4a236164 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:20:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ec22dbcb-7334-4e84-a120-89869b57bfea req-685540d2-af11-4e32-940f-ecee4a236164 service nova] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ec22dbcb-7334-4e84-a120-89869b57bfea req-685540d2-af11-4e32-940f-ecee4a236164 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ec22dbcb-7334-4e84-a120-89869b57bfea req-685540d2-af11-4e32-940f-ecee4a236164 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:03 user nova-compute[72019]: DEBUG nova.compute.manager [req-ec22dbcb-7334-4e84-a120-89869b57bfea req-685540d2-af11-4e32-940f-ecee4a236164 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] No waiting events found dispatching network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:20:03 user nova-compute[72019]: WARNING nova.compute.manager [req-ec22dbcb-7334-4e84-a120-89869b57bfea req-685540d2-af11-4e32-940f-ecee4a236164 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received unexpected event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e for instance with vm_state building and task_state spawning.
Apr 14 13:20:03 user nova-compute[72019]: INFO nova.compute.manager [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Took 16.18 seconds to build instance.
Apr 14 13:20:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "b7cdf352-a517-4296-bc70-400836915095" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.282s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:05 user nova-compute[72019]: DEBUG nova.objects.instance [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'flavor' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:20:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:20:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquired lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:20:05 user nova-compute[72019]: DEBUG nova.network.neutron [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:20:05 user nova-compute[72019]: DEBUG nova.objects.instance [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'info_cache' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.network.neutron [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Updating instance_info_cache with network_info: [{"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Releasing lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:20:06 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Instance destroyed successfully.
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.objects.instance [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'resources' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-303889780',display_name='tempest-AttachVolumeTestJSON-server-303889780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-303889780',id=2,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/dvc2S0OuXcn9jdXIUza2Um4pu7uvo7HYOG07F6fnb37QHZ7NdhG6QTqMXI3jbPISSO6VjhwOBRe6Loz+h6IedCzg/r0/inTPnR9XWKC/g2HpuZ9SyjRQ2J4QlDLD1WA==',key_name='tempest-keypair-641815070',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:12:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a82aa8e6724a41e1a4e4d7783876536e',ramdisk_id='',reservation_id='r-s06nam6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-581564101',owner_user_name='tempest-AttachVolumeTestJSON-581564101-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e4e432ab0d448db8c2437e40cbe0cd',uuid=84bf295a-37fa-4463-bddb-38ac2c5d2cf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converting VIF {"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG os_vif [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4b573e5-ec, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:20:06 user nova-compute[72019]: INFO os_vif [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec')
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Start _get_guest_xml network_info=[{"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.objects.instance [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'numa_topology' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:20:06 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:20:06 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.objects.instance [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'vcpu_model' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-303889780',display_name='tempest-AttachVolumeTestJSON-server-303889780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-303889780',id=2,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/dvc2S0OuXcn9jdXIUza2Um4pu7uvo7HYOG07F6fnb37QHZ7NdhG6QTqMXI3jbPISSO6VjhwOBRe6Loz+h6IedCzg/r0/inTPnR9XWKC/g2HpuZ9SyjRQ2J4QlDLD1WA==',key_name='tempest-keypair-641815070',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:12:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a82aa8e6724a41e1a4e4d7783876536e',ramdisk_id='',reservation_id='r-s06nam6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-581564101',owner_user_name='tempest-AttachVolumeTestJSON-581564101-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e4e432ab0d448db8c2437e40cbe0cd',uuid=84bf295a-37fa-4463-bddb-38ac2c5d2cf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converting VIF {"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.objects.instance [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'pci_devices' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:20:06 user nova-compute[72019]:   <uuid>84bf295a-37fa-4463-bddb-38ac2c5d2cf7</uuid>
Apr 14 13:20:06 user nova-compute[72019]:   <name>instance-00000002</name>
Apr 14 13:20:06 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:20:06 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:20:06 user nova-compute[72019]:   <metadata>
Apr 14 13:20:06 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:20:06 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:20:06 user nova-compute[72019]:       <nova:name>tempest-AttachVolumeTestJSON-server-303889780</nova:name>
Apr 14 13:20:06 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:20:06</nova:creationTime>
Apr 14 13:20:06 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:20:06 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:20:06 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:20:06 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:20:06 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:20:06 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:20:06 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:20:06 user nova-compute[72019]:       <nova:owner>
Apr 14 13:20:06 user nova-compute[72019]:         <nova:user uuid="d7e4e432ab0d448db8c2437e40cbe0cd">tempest-AttachVolumeTestJSON-581564101-project-member</nova:user>
Apr 14 13:20:06 user nova-compute[72019]:         <nova:project uuid="a82aa8e6724a41e1a4e4d7783876536e">tempest-AttachVolumeTestJSON-581564101</nova:project>
Apr 14 13:20:06 user nova-compute[72019]:       </nova:owner>
Apr 14 13:20:06 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:20:06 user nova-compute[72019]:       <nova:ports>
Apr 14 13:20:06 user nova-compute[72019]:         <nova:port uuid="e4b573e5-ec9a-4d14-974b-d8f2bf49c980">
Apr 14 13:20:06 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 13:20:06 user nova-compute[72019]:         </nova:port>
Apr 14 13:20:06 user nova-compute[72019]:       </nova:ports>
Apr 14 13:20:06 user nova-compute[72019]:     </nova:instance>
Apr 14 13:20:06 user nova-compute[72019]:   </metadata>
Apr 14 13:20:06 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:20:06 user nova-compute[72019]:     <system>
Apr 14 13:20:06 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:20:06 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:20:06 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:20:06 user nova-compute[72019]:       <entry name="serial">84bf295a-37fa-4463-bddb-38ac2c5d2cf7</entry>
Apr 14 13:20:06 user nova-compute[72019]:       <entry name="uuid">84bf295a-37fa-4463-bddb-38ac2c5d2cf7</entry>
Apr 14 13:20:06 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:20:06 user nova-compute[72019]:     </system>
Apr 14 13:20:06 user nova-compute[72019]:   </sysinfo>
Apr 14 13:20:06 user nova-compute[72019]:   <os>
Apr 14 13:20:06 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:20:06 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:20:06 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:20:06 user nova-compute[72019]:   </os>
Apr 14 13:20:06 user nova-compute[72019]:   <features>
Apr 14 13:20:06 user nova-compute[72019]:     <acpi/>
Apr 14 13:20:06 user nova-compute[72019]:     <apic/>
Apr 14 13:20:06 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:20:06 user nova-compute[72019]:   </features>
Apr 14 13:20:06 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:20:06 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:20:06 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:20:06 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:20:06 user nova-compute[72019]:   </clock>
Apr 14 13:20:06 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:20:06 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:20:06 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:20:06 user nova-compute[72019]:   </cpu>
Apr 14 13:20:06 user nova-compute[72019]:   <devices>
Apr 14 13:20:06 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:20:06 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:20:06 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk"/>
Apr 14 13:20:06 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:20:06 user nova-compute[72019]:     </disk>
Apr 14 13:20:06 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:20:06 user nova-compute[72019]:       <mac address="fa:16:3e:23:7a:d0"/>
Apr 14 13:20:06 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:20:06 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:20:06 user nova-compute[72019]:       <target dev="tape4b573e5-ec"/>
Apr 14 13:20:06 user nova-compute[72019]:     </interface>
Apr 14 13:20:06 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:20:06 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/console.log" append="off"/>
Apr 14 13:20:06 user nova-compute[72019]:     </serial>
Apr 14 13:20:06 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:20:06 user nova-compute[72019]:     <video>
Apr 14 13:20:06 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:20:06 user nova-compute[72019]:     </video>
Apr 14 13:20:06 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:20:06 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:20:06 user nova-compute[72019]:     </rng>
Apr 14 13:20:06 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:20:06 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:20:06 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:20:06 user nova-compute[72019]:     </memballoon>
Apr 14 13:20:06 user nova-compute[72019]:   </devices>
Apr 14 13:20:06 user nova-compute[72019]: </domain>
Apr 14 13:20:06 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.objects.instance [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'trusted_certs' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.133s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:20:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Cannot resize image /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG nova.objects.instance [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'migration_context' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-303889780',display_name='tempest-AttachVolumeTestJSON-server-303889780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-303889780',id=2,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/dvc2S0OuXcn9jdXIUza2Um4pu7uvo7HYOG07F6fnb37QHZ7NdhG6QTqMXI3jbPISSO6VjhwOBRe6Loz+h6IedCzg/r0/inTPnR9XWKC/g2HpuZ9SyjRQ2J4QlDLD1WA==',key_name='tempest-keypair-641815070',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:12:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a82aa8e6724a41e1a4e4d7783876536e',ramdisk_id='',reservation_id='r-s06nam6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-581564101',owner_user_name='tempest-AttachVolumeTestJSON-581564101-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e4e432ab0d448db8c2437e40cbe0cd',uuid=84bf295a-37fa-4463-bddb-38ac2c5d2cf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converting VIF {"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG os_vif [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4b573e5-ec, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4b573e5-ec, col_values=(('external_ids', {'iface-id': 'e4b573e5-ec9a-4d14-974b-d8f2bf49c980', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:7a:d0', 'vm-uuid': '84bf295a-37fa-4463-bddb-38ac2c5d2cf7'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:20:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:07 user nova-compute[72019]: INFO os_vif [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec')
Apr 14 13:20:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:08 user nova-compute[72019]: DEBUG nova.compute.manager [req-a6c1de05-434a-47c7-b08b-da8c5ec71588 req-b71d0eeb-8dea-456c-994e-99d4bae320c2 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:20:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a6c1de05-434a-47c7-b08b-da8c5ec71588 req-b71d0eeb-8dea-456c-994e-99d4bae320c2 service nova] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a6c1de05-434a-47c7-b08b-da8c5ec71588 req-b71d0eeb-8dea-456c-994e-99d4bae320c2 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a6c1de05-434a-47c7-b08b-da8c5ec71588 req-b71d0eeb-8dea-456c-994e-99d4bae320c2 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:08 user nova-compute[72019]: DEBUG nova.compute.manager [req-a6c1de05-434a-47c7-b08b-da8c5ec71588 req-b71d0eeb-8dea-456c-994e-99d4bae320c2 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] No waiting events found dispatching network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:20:08 user nova-compute[72019]: WARNING nova.compute.manager [req-a6c1de05-434a-47c7-b08b-da8c5ec71588 req-b71d0eeb-8dea-456c-994e-99d4bae320c2 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received unexpected event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance with vm_state stopped and task_state powering-on.
Apr 14 13:20:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-c682d603-0f8a-4d18-88b5-8a9bac5145e7 req-2e853226-5d41-4d27-ac14-5818243b16c2 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:20:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c682d603-0f8a-4d18-88b5-8a9bac5145e7 req-2e853226-5d41-4d27-ac14-5818243b16c2 service nova] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c682d603-0f8a-4d18-88b5-8a9bac5145e7 req-2e853226-5d41-4d27-ac14-5818243b16c2 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c682d603-0f8a-4d18-88b5-8a9bac5145e7 req-2e853226-5d41-4d27-ac14-5818243b16c2 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-c682d603-0f8a-4d18-88b5-8a9bac5145e7 req-2e853226-5d41-4d27-ac14-5818243b16c2 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] No waiting events found dispatching network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:20:10 user nova-compute[72019]: WARNING nova.compute.manager [req-c682d603-0f8a-4d18-88b5-8a9bac5145e7 req-2e853226-5d41-4d27-ac14-5818243b16c2 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received unexpected event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance with vm_state stopped and task_state powering-on.
Apr 14 13:20:10 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478410.9194746, 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:20:10 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] VM Resumed (Lifecycle Event)
Apr 14 13:20:10 user nova-compute[72019]: DEBUG nova.compute.manager [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:20:10 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Instance rebooted successfully.
Apr 14 13:20:10 user nova-compute[72019]: DEBUG nova.compute.manager [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:20:10 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:20:10 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:20:10 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 13:20:10 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478410.9207647, 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:20:10 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] VM Started (Lifecycle Event)
Apr 14 13:20:10 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:20:11 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:20:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:20:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:20:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:20:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:20:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:20:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:20:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:20:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:20:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:23 user nova-compute[72019]: INFO nova.compute.manager [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Terminating instance
Apr 14 13:20:23 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Rebuilding the list of instances to heal {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Skipping network cache update for instance because it is being deleted. {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG nova.objects.instance [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lazy-loading 'info_cache' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-8a44464f-9c42-4a1d-b93a-b03230037473 req-640fc16f-1ffe-4ceb-ae92-70d4db15ed38 service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Received event network-vif-unplugged-5a229da1-537f-4dce-b171-39cf5b5cd438 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8a44464f-9c42-4a1d-b93a-b03230037473 req-640fc16f-1ffe-4ceb-ae92-70d4db15ed38 service nova] Acquiring lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8a44464f-9c42-4a1d-b93a-b03230037473 req-640fc16f-1ffe-4ceb-ae92-70d4db15ed38 service nova] Lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8a44464f-9c42-4a1d-b93a-b03230037473 req-640fc16f-1ffe-4ceb-ae92-70d4db15ed38 service nova] Lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-8a44464f-9c42-4a1d-b93a-b03230037473 req-640fc16f-1ffe-4ceb-ae92-70d4db15ed38 service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] No waiting events found dispatching network-vif-unplugged-5a229da1-537f-4dce-b171-39cf5b5cd438 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-8a44464f-9c42-4a1d-b93a-b03230037473 req-640fc16f-1ffe-4ceb-ae92-70d4db15ed38 service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Received event network-vif-unplugged-5a229da1-537f-4dce-b171-39cf5b5cd438 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:20:24 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Instance destroyed successfully.
Apr 14 13:20:24 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lazy-loading 'resources' on Instance uuid 1e06aa11-247c-48ff-adc2-f321e6c72f1f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1833341696',display_name='tempest-ServersNegativeTestJSON-server-1833341696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1833341696',id=24,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:18:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4b4e44c0b8945079de567503aab3a12',ramdisk_id='',reservation_id='r-3r68qu7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-548588779',owner_user_name='tempest-ServersNegativeTestJSON-548588779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:18:45Z,user_data=None,user_id='3f713f95191542f6a23ee25669061b27',uuid=1e06aa11-247c-48ff-adc2-f321e6c72f1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a229da1-537f-4dce-b171-39cf5b5cd438", "address": "fa:16:3e:46:2c:69", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a229da1-53", "ovs_interfaceid": "5a229da1-537f-4dce-b171-39cf5b5cd438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Converting VIF {"id": "5a229da1-537f-4dce-b171-39cf5b5cd438", "address": "fa:16:3e:46:2c:69", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a229da1-53", "ovs_interfaceid": "5a229da1-537f-4dce-b171-39cf5b5cd438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:2c:69,bridge_name='br-int',has_traffic_filtering=True,id=5a229da1-537f-4dce-b171-39cf5b5cd438,network=Network(73061151-2d01-43ae-9ac6-841d71c038ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a229da1-53') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG os_vif [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:2c:69,bridge_name='br-int',has_traffic_filtering=True,id=5a229da1-537f-4dce-b171-39cf5b5cd438,network=Network(73061151-2d01-43ae-9ac6-841d71c038ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a229da1-53') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a229da1-53, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:20:24 user nova-compute[72019]: INFO os_vif [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:2c:69,bridge_name='br-int',has_traffic_filtering=True,id=5a229da1-537f-4dce-b171-39cf5b5cd438,network=Network(73061151-2d01-43ae-9ac6-841d71c038ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a229da1-53')
Apr 14 13:20:24 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Deleting instance files /opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f_del
Apr 14 13:20:24 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Deletion of /opt/stack/data/nova/instances/1e06aa11-247c-48ff-adc2-f321e6c72f1f_del complete
Apr 14 13:20:24 user nova-compute[72019]: INFO nova.compute.manager [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 14 13:20:24 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:20:24 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Updating instance_info_cache with network_info: [{"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-84bf295a-37fa-4463-bddb-38ac2c5d2cf7" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:20:25 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Took 0.87 seconds to deallocate network for instance.
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.546s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:26 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Deleted allocations for instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.487s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-4b802ee3-96c8-430b-b801-e5caac871416 req-b79b9821-776a-4d6f-a30d-e369487cce7e service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Received event network-vif-plugged-5a229da1-537f-4dce-b171-39cf5b5cd438 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4b802ee3-96c8-430b-b801-e5caac871416 req-b79b9821-776a-4d6f-a30d-e369487cce7e service nova] Acquiring lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4b802ee3-96c8-430b-b801-e5caac871416 req-b79b9821-776a-4d6f-a30d-e369487cce7e service nova] Lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4b802ee3-96c8-430b-b801-e5caac871416 req-b79b9821-776a-4d6f-a30d-e369487cce7e service nova] Lock "1e06aa11-247c-48ff-adc2-f321e6c72f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-4b802ee3-96c8-430b-b801-e5caac871416 req-b79b9821-776a-4d6f-a30d-e369487cce7e service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] No waiting events found dispatching network-vif-plugged-5a229da1-537f-4dce-b171-39cf5b5cd438 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:20:26 user nova-compute[72019]: WARNING nova.compute.manager [req-4b802ee3-96c8-430b-b801-e5caac871416 req-b79b9821-776a-4d6f-a30d-e369487cce7e service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Received unexpected event network-vif-plugged-5a229da1-537f-4dce-b171-39cf5b5cd438 for instance with vm_state deleted and task_state None.
Apr 14 13:20:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-4b802ee3-96c8-430b-b801-e5caac871416 req-b79b9821-776a-4d6f-a30d-e369487cce7e service nova] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Received event network-vif-deleted-5a229da1-537f-4dce-b171-39cf5b5cd438 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:20:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:20:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:20:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:20:29 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:20:29 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7516MB free_disk=26.220989227294922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:20:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:20:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:39 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478424.525086, 1e06aa11-247c-48ff-adc2-f321e6c72f1f => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:20:39 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] VM Stopped (Lifecycle Event)
Apr 14 13:20:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-33ea1d9f-2528-4df0-8635-8da3d2338167 None None] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:20:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:20:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:55 user nova-compute[72019]: INFO nova.compute.manager [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Terminating instance
Apr 14 13:20:55 user nova-compute[72019]: DEBUG nova.compute.manager [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG nova.compute.manager [req-1c46737f-1ba8-47fe-b915-0abf88eab1ae req-db1b16c4-0e31-492a-b966-5508f80b5451 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Received event network-vif-unplugged-55e6da39-5c8f-43dc-a24b-cd2e266b4752 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c46737f-1ba8-47fe-b915-0abf88eab1ae req-db1b16c4-0e31-492a-b966-5508f80b5451 service nova] Acquiring lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c46737f-1ba8-47fe-b915-0abf88eab1ae req-db1b16c4-0e31-492a-b966-5508f80b5451 service nova] Lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c46737f-1ba8-47fe-b915-0abf88eab1ae req-db1b16c4-0e31-492a-b966-5508f80b5451 service nova] Lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG nova.compute.manager [req-1c46737f-1ba8-47fe-b915-0abf88eab1ae req-db1b16c4-0e31-492a-b966-5508f80b5451 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] No waiting events found dispatching network-vif-unplugged-55e6da39-5c8f-43dc-a24b-cd2e266b4752 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:20:55 user nova-compute[72019]: DEBUG nova.compute.manager [req-1c46737f-1ba8-47fe-b915-0abf88eab1ae req-db1b16c4-0e31-492a-b966-5508f80b5451 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Received event network-vif-unplugged-55e6da39-5c8f-43dc-a24b-cd2e266b4752 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:20:56 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Instance destroyed successfully.
Apr 14 13:20:56 user nova-compute[72019]: DEBUG nova.objects.instance [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lazy-loading 'resources' on Instance uuid 0e675870-c86b-4ac2-a581-dbad2bdb71ec {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:20:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1043455417',display_name='tempest-VolumesNegativeTest-instance-1043455417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1043455417',id=25,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:19:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcea4bc3b35746889e1f72cd621d501b',ramdisk_id='',reservation_id='r-uhzfi7wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1899611102',owner_user_name='tempest-VolumesNegativeTest-1899611102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:19:14Z,user_data=None,user_id='f0868a82043f44a7bc91fc8c6785dc1e',uuid=0e675870-c86b-4ac2-a581-dbad2bdb71ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "address": "fa:16:3e:c4:fe:fe", "network": {"id": "18472354-e0f8-402a-ac00-3beb5e5b7341", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae9501805cab47aaa3a6e2553987bd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e6da39-5c", "ovs_interfaceid": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:20:56 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Converting VIF {"id": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "address": "fa:16:3e:c4:fe:fe", "network": {"id": "18472354-e0f8-402a-ac00-3beb5e5b7341", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ae9501805cab47aaa3a6e2553987bd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e6da39-5c", "ovs_interfaceid": "55e6da39-5c8f-43dc-a24b-cd2e266b4752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:20:56 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fe:fe,bridge_name='br-int',has_traffic_filtering=True,id=55e6da39-5c8f-43dc-a24b-cd2e266b4752,network=Network(18472354-e0f8-402a-ac00-3beb5e5b7341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e6da39-5c') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:20:56 user nova-compute[72019]: DEBUG os_vif [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fe:fe,bridge_name='br-int',has_traffic_filtering=True,id=55e6da39-5c8f-43dc-a24b-cd2e266b4752,network=Network(18472354-e0f8-402a-ac00-3beb5e5b7341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e6da39-5c') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:20:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55e6da39-5c, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:20:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:20:56 user nova-compute[72019]: INFO os_vif [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:fe:fe,bridge_name='br-int',has_traffic_filtering=True,id=55e6da39-5c8f-43dc-a24b-cd2e266b4752,network=Network(18472354-e0f8-402a-ac00-3beb5e5b7341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e6da39-5c')
Apr 14 13:20:56 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Deleting instance files /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec_del
Apr 14 13:20:56 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Deletion of /opt/stack/data/nova/instances/0e675870-c86b-4ac2-a581-dbad2bdb71ec_del complete
Apr 14 13:20:56 user nova-compute[72019]: INFO nova.compute.manager [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 14 13:20:56 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:20:56 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:20:56 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:20:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:20:57 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:20:57 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Took 1.11 seconds to deallocate network for instance.
Apr 14 13:20:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-c44a9d9a-2b23-443a-82c7-9897a7e8ba52 req-c40864c1-0a13-4fa2-8aeb-41251cffc017 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Received event network-vif-deleted-55e6da39-5c8f-43dc-a24b-cd2e266b4752 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:20:57 user nova-compute[72019]: INFO nova.compute.manager [req-c44a9d9a-2b23-443a-82c7-9897a7e8ba52 req-c40864c1-0a13-4fa2-8aeb-41251cffc017 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Neutron deleted interface 55e6da39-5c8f-43dc-a24b-cd2e266b4752; detaching it from the instance and deleting it from the info cache
Apr 14 13:20:57 user nova-compute[72019]: DEBUG nova.network.neutron [req-c44a9d9a-2b23-443a-82c7-9897a7e8ba52 req-c40864c1-0a13-4fa2-8aeb-41251cffc017 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:20:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-c44a9d9a-2b23-443a-82c7-9897a7e8ba52 req-c40864c1-0a13-4fa2-8aeb-41251cffc017 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Detach interface failed, port_id=55e6da39-5c8f-43dc-a24b-cd2e266b4752, reason: Instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:20:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-adce51d2-401e-41e4-b186-9108b8654573 req-27d01422-fb71-4b91-aed7-cd720b7fdee3 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Received event network-vif-plugged-55e6da39-5c8f-43dc-a24b-cd2e266b4752 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:20:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-adce51d2-401e-41e4-b186-9108b8654573 req-27d01422-fb71-4b91-aed7-cd720b7fdee3 service nova] Acquiring lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:20:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-adce51d2-401e-41e4-b186-9108b8654573 req-27d01422-fb71-4b91-aed7-cd720b7fdee3 service nova] Lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:20:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-adce51d2-401e-41e4-b186-9108b8654573 req-27d01422-fb71-4b91-aed7-cd720b7fdee3 service nova] Lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-adce51d2-401e-41e4-b186-9108b8654573 req-27d01422-fb71-4b91-aed7-cd720b7fdee3 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] No waiting events found dispatching network-vif-plugged-55e6da39-5c8f-43dc-a24b-cd2e266b4752 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:20:57 user nova-compute[72019]: WARNING nova.compute.manager [req-adce51d2-401e-41e4-b186-9108b8654573 req-27d01422-fb71-4b91-aed7-cd720b7fdee3 service nova] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Received unexpected event network-vif-plugged-55e6da39-5c8f-43dc-a24b-cd2e266b4752 for instance with vm_state deleted and task_state None.
Apr 14 13:20:58 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:20:58 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:20:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:20:58 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Deleted allocations for instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec
Apr 14 13:20:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "0e675870-c86b-4ac2-a581-dbad2bdb71ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.675s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "775293fc-1773-407d-bf49-fccfe849f440" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:06 user nova-compute[72019]: DEBUG nova.compute.manager [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:21:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:06 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:21:06 user nova-compute[72019]: INFO nova.compute.claims [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Claim successful on node user
Apr 14 13:21:06 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:21:06 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:21:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:06 user nova-compute[72019]: DEBUG nova.compute.manager [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:21:06 user nova-compute[72019]: DEBUG nova.compute.manager [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:21:06 user nova-compute[72019]: DEBUG nova.network.neutron [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:21:06 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG nova.objects.instance [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'flavor' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-aaa3ae1d-bba6-4f52-bc34-5014f7bcaad6 req-a65afb9f-29e9-4e25-821a-15581b9eebff service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Received event network-changed-e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-aaa3ae1d-bba6-4f52-bc34-5014f7bcaad6 req-a65afb9f-29e9-4e25-821a-15581b9eebff service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Refreshing instance network info cache due to event network-changed-e4d4e52c-5363-4345-9db1-022e8287c65a. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aaa3ae1d-bba6-4f52-bc34-5014f7bcaad6 req-a65afb9f-29e9-4e25-821a-15581b9eebff service nova] Acquiring lock "refresh_cache-dca3424c-cbca-4520-a495-8867c2a9c0c4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aaa3ae1d-bba6-4f52-bc34-5014f7bcaad6 req-a65afb9f-29e9-4e25-821a-15581b9eebff service nova] Acquired lock "refresh_cache-dca3424c-cbca-4520-a495-8867c2a9c0c4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG nova.network.neutron [req-aaa3ae1d-bba6-4f52-bc34-5014f7bcaad6 req-a65afb9f-29e9-4e25-821a-15581b9eebff service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Refreshing network info cache for port e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:21:07 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Creating image(s)
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "/opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "/opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "/opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:07 user nova-compute[72019]: INFO nova.compute.manager [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Attaching volume 0dc33843-6235-4794-844e-9fc4db46c60e to /dev/vdb
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.165s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG os_brick.utils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d21cc05-cda2-4a11-a30d-e96e9e4deea2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba70229a-be79-44e8-982a-c28236d21310]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.042s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd09279-201f-4831-a633-732735d14a50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[811d66c8-fb0c-4ce4-a1d2-f8aa3036fe74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.177s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:21:07 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[53199477-26b7-40e9-b58c-cd04052be9d6]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG os_brick.utils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating existing volume attachment record: 30c34a81-0271-4674-9f05-163066f85f94 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk 1073741824" returned: 0 in 0.064s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.172s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Checking if we can resize image /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG nova.policy [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Cannot resize image /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG nova.objects.instance [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'migration_context' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Ensure instance console log exists: /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:08 user nova-compute[72019]: DEBUG nova.network.neutron [req-aaa3ae1d-bba6-4f52-bc34-5014f7bcaad6 req-a65afb9f-29e9-4e25-821a-15581b9eebff service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Updated VIF entry in instance network info cache for port e4d4e52c-5363-4345-9db1-022e8287c65a. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:21:08 user nova-compute[72019]: DEBUG nova.network.neutron [req-aaa3ae1d-bba6-4f52-bc34-5014f7bcaad6 req-a65afb9f-29e9-4e25-821a-15581b9eebff service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Updating instance_info_cache with network_info: [{"id": "e4d4e52c-5363-4345-9db1-022e8287c65a", "address": "fa:16:3e:dd:8e:8b", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d4e52c-53", "ovs_interfaceid": "e4d4e52c-5363-4345-9db1-022e8287c65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:21:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aaa3ae1d-bba6-4f52-bc34-5014f7bcaad6 req-a65afb9f-29e9-4e25-821a-15581b9eebff service nova] Releasing lock "refresh_cache-dca3424c-cbca-4520-a495-8867c2a9c0c4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:21:08 user nova-compute[72019]: DEBUG nova.network.neutron [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Successfully created port: aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:21:09 user nova-compute[72019]: DEBUG nova.network.neutron [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Successfully updated port: aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:21:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:21:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquired lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:21:09 user nova-compute[72019]: DEBUG nova.network.neutron [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:21:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-8025f476-fa5f-4cda-8b78-b5d3b155a8e2 req-f222f384-f90f-453f-b479-e4bd17c4c581 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-changed-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-8025f476-fa5f-4cda-8b78-b5d3b155a8e2 req-f222f384-f90f-453f-b479-e4bd17c4c581 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Refreshing instance network info cache due to event network-changed-aef4cd67-4e33-4456-b7d9-195955db1cdc. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:21:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8025f476-fa5f-4cda-8b78-b5d3b155a8e2 req-f222f384-f90f-453f-b479-e4bd17c4c581 service nova] Acquiring lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:21:09 user nova-compute[72019]: DEBUG nova.network.neutron [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:21:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:09 user nova-compute[72019]: DEBUG nova.objects.instance [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'flavor' on Instance uuid dca3424c-cbca-4520-a495-8867c2a9c0c4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:10 user nova-compute[72019]: INFO nova.compute.manager [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Attaching volume 55eed418-6cb1-4596-aad1-2a05d54e57c2 to /dev/vdb
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.network.neutron [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Updating instance_info_cache with network_info: [{"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Releasing lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.compute.manager [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Instance network_info: |[{"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG os_brick.utils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8025f476-fa5f-4cda-8b78-b5d3b155a8e2 req-f222f384-f90f-453f-b479-e4bd17c4c581 service nova] Acquired lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.network.neutron [req-8025f476-fa5f-4cda-8b78-b5d3b155a8e2 req-f222f384-f90f-453f-b479-e4bd17c4c581 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Refreshing network info cache for port aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Start _get_guest_xml network_info=[{"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[787f1299-3868-402b-8ff6-f1f576cdb0b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:10 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:21:10 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1752142358',display_name='tempest-ServerRescueNegativeTestJSON-server-1752142358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1752142358',id=28,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8A7EAZq7tmqrVNMLohBE3mL47WklU/y0g3C4awZJlk7zTwzptrakKyJKVosEv0afOebqhON5GWZWdR8IogeuUlgLuKQn8gHHZsiUBVmRBYXQ+jLuDfBW7YAbRSIevoPw==',key_name='tempest-keypair-1544885661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7c8c8f620334166a141ea65525ba2a0',ramdisk_id='',reservation_id='r-w6mtz06d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1698214771',owner_user_name='tempest-ServerRescueNegativeTestJSON-1698214771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3948b7c643374bcdbeb34f0f2f790c3c',uuid=775293fc-1773-407d-bf49-fccfe849f440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converting VIF {"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:e7:34,bridge_name='br-int',has_traffic_filtering=True,id=aef4cd67-4e33-4456-b7d9-195955db1cdc,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef4cd67-4e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.objects.instance [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'pci_devices' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92b91f9-129d-4b1a-8b26-2d278995cba4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:21:10 user nova-compute[72019]:   <uuid>775293fc-1773-407d-bf49-fccfe849f440</uuid>
Apr 14 13:21:10 user nova-compute[72019]:   <name>instance-0000001c</name>
Apr 14 13:21:10 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:21:10 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:21:10 user nova-compute[72019]:   <metadata>
Apr 14 13:21:10 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:21:10 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:21:10 user nova-compute[72019]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1752142358</nova:name>
Apr 14 13:21:10 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:21:10</nova:creationTime>
Apr 14 13:21:10 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:21:10 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:21:10 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:21:10 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:21:10 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:21:10 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:21:10 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:21:10 user nova-compute[72019]:       <nova:owner>
Apr 14 13:21:10 user nova-compute[72019]:         <nova:user uuid="3948b7c643374bcdbeb34f0f2f790c3c">tempest-ServerRescueNegativeTestJSON-1698214771-project-member</nova:user>
Apr 14 13:21:10 user nova-compute[72019]:         <nova:project uuid="a7c8c8f620334166a141ea65525ba2a0">tempest-ServerRescueNegativeTestJSON-1698214771</nova:project>
Apr 14 13:21:10 user nova-compute[72019]:       </nova:owner>
Apr 14 13:21:10 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:21:10 user nova-compute[72019]:       <nova:ports>
Apr 14 13:21:10 user nova-compute[72019]:         <nova:port uuid="aef4cd67-4e33-4456-b7d9-195955db1cdc">
Apr 14 13:21:10 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 13:21:10 user nova-compute[72019]:         </nova:port>
Apr 14 13:21:10 user nova-compute[72019]:       </nova:ports>
Apr 14 13:21:10 user nova-compute[72019]:     </nova:instance>
Apr 14 13:21:10 user nova-compute[72019]:   </metadata>
Apr 14 13:21:10 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:21:10 user nova-compute[72019]:     <system>
Apr 14 13:21:10 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:21:10 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:21:10 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:21:10 user nova-compute[72019]:       <entry name="serial">775293fc-1773-407d-bf49-fccfe849f440</entry>
Apr 14 13:21:10 user nova-compute[72019]:       <entry name="uuid">775293fc-1773-407d-bf49-fccfe849f440</entry>
Apr 14 13:21:10 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:21:10 user nova-compute[72019]:     </system>
Apr 14 13:21:10 user nova-compute[72019]:   </sysinfo>
Apr 14 13:21:10 user nova-compute[72019]:   <os>
Apr 14 13:21:10 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:21:10 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:21:10 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:21:10 user nova-compute[72019]:   </os>
Apr 14 13:21:10 user nova-compute[72019]:   <features>
Apr 14 13:21:10 user nova-compute[72019]:     <acpi/>
Apr 14 13:21:10 user nova-compute[72019]:     <apic/>
Apr 14 13:21:10 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:21:10 user nova-compute[72019]:   </features>
Apr 14 13:21:10 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:21:10 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:21:10 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:21:10 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:21:10 user nova-compute[72019]:   </clock>
Apr 14 13:21:10 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:21:10 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:21:10 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:21:10 user nova-compute[72019]:   </cpu>
Apr 14 13:21:10 user nova-compute[72019]:   <devices>
Apr 14 13:21:10 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:21:10 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:21:10 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk"/>
Apr 14 13:21:10 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:21:10 user nova-compute[72019]:     </disk>
Apr 14 13:21:10 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:21:10 user nova-compute[72019]:       <mac address="fa:16:3e:44:e7:34"/>
Apr 14 13:21:10 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:21:10 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:21:10 user nova-compute[72019]:       <target dev="tapaef4cd67-4e"/>
Apr 14 13:21:10 user nova-compute[72019]:     </interface>
Apr 14 13:21:10 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:21:10 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/console.log" append="off"/>
Apr 14 13:21:10 user nova-compute[72019]:     </serial>
Apr 14 13:21:10 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:21:10 user nova-compute[72019]:     <video>
Apr 14 13:21:10 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:21:10 user nova-compute[72019]:     </video>
Apr 14 13:21:10 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:21:10 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:21:10 user nova-compute[72019]:     </rng>
Apr 14 13:21:10 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:21:10 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:21:10 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:21:10 user nova-compute[72019]:     </memballoon>
Apr 14 13:21:10 user nova-compute[72019]:   </devices>
Apr 14 13:21:10 user nova-compute[72019]: </domain>
Apr 14 13:21:10 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1752142358',display_name='tempest-ServerRescueNegativeTestJSON-server-1752142358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1752142358',id=28,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8A7EAZq7tmqrVNMLohBE3mL47WklU/y0g3C4awZJlk7zTwzptrakKyJKVosEv0afOebqhON5GWZWdR8IogeuUlgLuKQn8gHHZsiUBVmRBYXQ+jLuDfBW7YAbRSIevoPw==',key_name='tempest-keypair-1544885661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7c8c8f620334166a141ea65525ba2a0',ramdisk_id='',reservation_id='r-w6mtz06d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1698214771',owner_user_name='tempest-ServerRescueNegativeTestJSON-1698214771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3948b7c643374bcdbeb34f0f2f790c3c',uuid=775293fc-1773-407d-bf49-fccfe849f440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converting VIF {"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:e7:34,bridge_name='br-int',has_traffic_filtering=True,id=aef4cd67-4e33-4456-b7d9-195955db1cdc,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef4cd67-4e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG os_vif [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:e7:34,bridge_name='br-int',has_traffic_filtering=True,id=aef4cd67-4e33-4456-b7d9-195955db1cdc,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef4cd67-4e') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6678f95f-d969-4f03-b73f-e6629404e16f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaef4cd67-4e, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaef4cd67-4e, col_values=(('external_ids', {'iface-id': 'aef4cd67-4e33-4456-b7d9-195955db1cdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:e7:34', 'vm-uuid': '775293fc-1773-407d-bf49-fccfe849f440'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[593061b1-88f4-41f0-a6c2-5da6fd807ffa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:21:10 user nova-compute[72019]: INFO os_vif [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:e7:34,bridge_name='br-int',has_traffic_filtering=True,id=aef4cd67-4e33-4456-b7d9-195955db1cdc,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef4cd67-4e')
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:21:10 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6f1742-f990-48cc-b810-bf52a327be70]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG os_brick.utils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] <== get_connector_properties: return (227ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Updating existing volume attachment record: 0b6b2ade-c149-405b-87e2-35e1b44a2ba2 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No VIF found with MAC fa:16:3e:44:e7:34, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.network.neutron [req-8025f476-fa5f-4cda-8b78-b5d3b155a8e2 req-f222f384-f90f-453f-b479-e4bd17c4c581 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Updated VIF entry in instance network info cache for port aef4cd67-4e33-4456-b7d9-195955db1cdc. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG nova.network.neutron [req-8025f476-fa5f-4cda-8b78-b5d3b155a8e2 req-f222f384-f90f-453f-b479-e4bd17c4c581 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Updating instance_info_cache with network_info: [{"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:21:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8025f476-fa5f-4cda-8b78-b5d3b155a8e2 req-f222f384-f90f-453f-b479-e4bd17c4c581 service nova] Releasing lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:21:11 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478456.4057143, 0e675870-c86b-4ac2-a581-dbad2bdb71ec => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:21:11 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] VM Stopped (Lifecycle Event)
Apr 14 13:21:11 user nova-compute[72019]: DEBUG nova.compute.manager [None req-7d518cb3-450f-41ad-b336-e6228926d95d None None] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-55476349-620b-4c2b-86d5-2b18cd31042e req-37a33ab2-2e86-4013-b2ae-006c44a7c865 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-55476349-620b-4c2b-86d5-2b18cd31042e req-37a33ab2-2e86-4013-b2ae-006c44a7c865 service nova] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-55476349-620b-4c2b-86d5-2b18cd31042e req-37a33ab2-2e86-4013-b2ae-006c44a7c865 service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-55476349-620b-4c2b-86d5-2b18cd31042e req-37a33ab2-2e86-4013-b2ae-006c44a7c865 service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-55476349-620b-4c2b-86d5-2b18cd31042e req-37a33ab2-2e86-4013-b2ae-006c44a7c865 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] No waiting events found dispatching network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:12 user nova-compute[72019]: WARNING nova.compute.manager [req-55476349-620b-4c2b-86d5-2b18cd31042e req-37a33ab2-2e86-4013-b2ae-006c44a7c865 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received unexpected event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc for instance with vm_state building and task_state spawning.
Apr 14 13:21:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGdkAJCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:12 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:12 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:12 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3e16b6-4380-4623-be6a-d9687f73dde0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:21:12 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[781058e2-9728-46e7-b28a-a5a9b02af55a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e] added
Apr 14 13:21:12 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21744dc-2bce-4bc9-ae62-ceb7f3efe0c2]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eb7734-d4bb-495a-9d8f-b142aeea84a0]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGdkAJCg {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGdkAJCg" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a139c16-a5c3-443d-9519-04a9a4f6f210]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NGdkAJCg'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2f3a72-f3bf-4c47-a88f-683e04b907de]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2417f29-0deb-4b20-b158-7833b188d4f3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:12 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:12 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:12 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:12 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ad6403-ce44-4d49-bdf3-e80af79431c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260]
Apr 14 13:21:12 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260] successful.
Apr 14 13:21:12 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6e14de-f573-4716-a18e-09963362fa9c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d18d77-b415-4176-a20f-da4e96c7fce5]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:13 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:13 user nova-compute[72019]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:13 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:13 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:13 user nova-compute[72019]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:13 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:21:13 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:21:13 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:21:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.035s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[399eb043-81f4-4e57-a678-fd3d4514959f]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:13 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:21:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGdkAJCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26563623666303235', 'path': '/dev/sdd'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563623666303235', 'path': '/dev/sdd'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.objects.instance [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'flavor' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:21:14 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:21:14 user nova-compute[72019]:   <source dev="/dev/sdd"/>
Apr 14 13:21:14 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:21:14 user nova-compute[72019]:   <serial>0dc33843-6235-4794-844e-9fc4db46c60e</serial>
Apr 14 13:21:14 user nova-compute[72019]: </disk>
Apr 14 13:21:14 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-da90b01d-430b-4e54-b99a-969900bedb54 req-7cb9a4a6-6534-4535-819a-ea263a381cf2 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-da90b01d-430b-4e54-b99a-969900bedb54 req-7cb9a4a6-6534-4535-819a-ea263a381cf2 service nova] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-da90b01d-430b-4e54-b99a-969900bedb54 req-7cb9a4a6-6534-4535-819a-ea263a381cf2 service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-da90b01d-430b-4e54-b99a-969900bedb54 req-7cb9a4a6-6534-4535-819a-ea263a381cf2 service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-da90b01d-430b-4e54-b99a-969900bedb54 req-7cb9a4a6-6534-4535-819a-ea263a381cf2 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] No waiting events found dispatching network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:14 user nova-compute[72019]: WARNING nova.compute.manager [req-da90b01d-430b-4e54-b99a-969900bedb54 req-7cb9a4a6-6534-4535-819a-ea263a381cf2 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received unexpected event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc for instance with vm_state building and task_state spawning.
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478474.3969085, 775293fc-1773-407d-bf49-fccfe849f440 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:21:14 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] VM Resumed (Lifecycle Event)
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:21:14 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Instance spawned successfully.
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:14 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478474.3985906, 775293fc-1773-407d-bf49-fccfe849f440 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:21:14 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] VM Started (Lifecycle Event)
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:21:14 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:21:14 user nova-compute[72019]: INFO nova.compute.manager [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Took 7.41 seconds to spawn the instance on the hypervisor.
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No VIF found with MAC fa:16:3e:28:28:75, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:21:14 user nova-compute[72019]: INFO nova.compute.manager [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Took 8.30 seconds to build instance.
Apr 14 13:21:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "775293fc-1773-407d-bf49-fccfe849f440" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.412s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.510s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VmBepXEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:15 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:21:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:15 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:21:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:15 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:21:15 user nova-compute[72019]: INFO nova.compute.claims [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Claim successful on node user
Apr 14 13:21:15 user nova-compute[72019]: INFO nova.compute.manager [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Rebuilding instance
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a9e383-6dbc-455c-87cc-2cf4f399cee7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:21:15 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6606b6c-92ce-43a7-827b-c7c4abe71843]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2] added
Apr 14 13:21:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG nova.objects.instance [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc76465-2d5f-4a3f-b07a-942d3e0aa1c2]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG nova.compute.manager [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e616bd-9535-444c-b951-f795cf981628]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VmBepXEs {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG nova.objects.instance [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'pci_requests' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VmBepXEs" returned: 0 in 0.038s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b6f435-d8ef-468d-ae26-152afd6001f1]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VmBepXEs'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG nova.objects.instance [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG nova.objects.instance [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'resources' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4614c7-3dd6-495e-84bf-b05fadd7e737]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG nova.objects.instance [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'migration_context' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG nova.objects.instance [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72019) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e07c49-30ea-4e7a-bafe-786658611194]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:15 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:15 user nova-compute[72019]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:15 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:15 user nova-compute[72019]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[da98c7d8-7864-4f08-bfb9-22cf0a273ec9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2, portal: 172.16.0.220,3260]
Apr 14 13:21:16 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2, portal: 172.16.0.220,3260] successful.
Apr 14 13:21:16 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f23442-f866-4172-886e-49e91ccb03fb]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c02e421-6570-470b-a3a2-e39d88fe9f95]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:16 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:16 user nova-compute[72019]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:16 user nova-compute[72019]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 (non-flash)
Apr 14 13:21:16 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:16 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:16 user nova-compute[72019]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:16 user nova-compute[72019]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 (non-flash)
Apr 14 13:21:16 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23795a0-0498-4370-860e-e40d921278ed]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VmBepXEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-46fc7068-97ca-4821-8e30-02a8f2ab3a47 req-a8a43f63-5b49-4076-acbb-d2c38583dcac service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46fc7068-97ca-4821-8e30-02a8f2ab3a47 req-a8a43f63-5b49-4076-acbb-d2c38583dcac service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46fc7068-97ca-4821-8e30-02a8f2ab3a47 req-a8a43f63-5b49-4076-acbb-d2c38583dcac service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46fc7068-97ca-4821-8e30-02a8f2ab3a47 req-a8a43f63-5b49-4076-acbb-d2c38583dcac service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-46fc7068-97ca-4821-8e30-02a8f2ab3a47 req-a8a43f63-5b49-4076-acbb-d2c38583dcac service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:16 user nova-compute[72019]: WARNING nova.compute.manager [req-46fc7068-97ca-4821-8e30-02a8f2ab3a47 req-a8a43f63-5b49-4076-acbb-d2c38583dcac service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state active and task_state rebuilding.
Apr 14 13:21:16 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:21:16 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:21:16 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:21:16 user nova-compute[72019]: INFO nova.virt.block_device [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Booting with volume snapshot 6834b709-2b53-483e-a90a-520b7a7cb4f9 at /dev/vda
Apr 14 13:21:16 user nova-compute[72019]: DEBUG nova.policy [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:21:16 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance destroyed successfully.
Apr 14 13:21:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:16 user nova-compute[72019]: INFO nova.compute.manager [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Detaching volume 0dc33843-6235-4794-844e-9fc4db46c60e
Apr 14 13:21:16 user nova-compute[72019]: INFO nova.virt.block_device [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Attempting to driver detach volume 0dc33843-6235-4794-844e-9fc4db46c60e from mountpoint /dev/vdb
Apr 14 13:21:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Attempting to detach device vdb from instance 6e646c88-579e-4ea1-b987-da1c7194a064 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:21:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:21:16 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:21:16 user nova-compute[72019]:   <source dev="/dev/sdd"/>
Apr 14 13:21:16 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:21:16 user nova-compute[72019]:   <serial>0dc33843-6235-4794-844e-9fc4db46c60e</serial>
Apr 14 13:21:16 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:21:16 user nova-compute[72019]: </disk>
Apr 14 13:21:16 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:21:17 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully detached device vdb from instance 6e646c88-579e-4ea1-b987-da1c7194a064 from the persistent domain config.
Apr 14 13:21:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGdkAJCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:17 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.472s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] <== connect_volume: return (1474ms) {'type': 'block', 'scsi_wwn': '23162653131306132', 'path': '/dev/sde'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162653131306132', 'path': '/dev/sde'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.108s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG nova.objects.instance [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'flavor' on Instance uuid dca3424c-cbca-4520-a495-8867c2a9c0c4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0671e9ed-64ae-480b-9ccc-f992e7b8dbb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:21:17 user nova-compute[72019]: No targets found.
Apr 14 13:21:17 user nova-compute[72019]: iSNS:
Apr 14 13:21:17 user nova-compute[72019]: No targets found.
Apr 14 13:21:17 user nova-compute[72019]: STATIC:
Apr 14 13:21:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:21:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507
Apr 14 13:21:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e
Apr 14 13:21:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:17 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2
Apr 14 13:21:17 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:17 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:17 user nova-compute[72019]: FIRMWARE:
Apr 14 13:21:17 user nova-compute[72019]: No targets found.
Apr 14 13:21:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:21:17 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:21:17 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:21:17 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:21:17 user nova-compute[72019]:   <source dev="/dev/sde"/>
Apr 14 13:21:17 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:21:17 user nova-compute[72019]:   <serial>55eed418-6cb1-4596-aad1-2a05d54e57c2</serial>
Apr 14 13:21:17 user nova-compute[72019]: </disk>
Apr 14 13:21:17 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd79a82-4cd5-41d6-84a2-58b98c9fd974]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6655475d-488b-4809-bec3-8f0b4aa79d17]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:17 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:17 user nova-compute[72019]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:17 user nova-compute[72019]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 (non-flash)
Apr 14 13:21:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:17 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:17 user nova-compute[72019]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:17 user nova-compute[72019]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 (non-flash)
Apr 14 13:21:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74882a8a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e'): ({'sdd'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Removing single pathed devices sdd {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5316ae3d-dfa3-4133-abce-3712bc3230c3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abbc798-29df-45f2-aa3b-6926b175f056]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flushing IO for device /dev/sdd {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Successfully created port: 4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cd9944-3b23-43f6-900b-1b21774b5025]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.175s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0ca43f-2eba-480b-b9ba-4ed526795832]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] SCSI volumes sdd have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e480a9-66e8-42f5-81b6-b743f626bea9]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[adeb2185-74b6-4280-b049-dc20f53f5f50]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260]
Apr 14 13:21:17 user nova-compute[72019]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260] successful.
Apr 14 13:21:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e78d4f-2bf7-4ffa-ac37-d5c75b809823]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.531s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== disconnect_volume: return (639ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No VIF found with MAC fa:16:3e:dd:8e:8b, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:21:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.833s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-e2f76de6-0876-4aa7-933e-ae09990d84c3 req-e16b909b-42cf-416a-ae77-66dea7cd4a65 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e2f76de6-0876-4aa7-933e-ae09990d84c3 req-e16b909b-42cf-416a-ae77-66dea7cd4a65 service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e2f76de6-0876-4aa7-933e-ae09990d84c3 req-e16b909b-42cf-416a-ae77-66dea7cd4a65 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e2f76de6-0876-4aa7-933e-ae09990d84c3 req-e16b909b-42cf-416a-ae77-66dea7cd4a65 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-e2f76de6-0876-4aa7-933e-ae09990d84c3 req-e16b909b-42cf-416a-ae77-66dea7cd4a65 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:18 user nova-compute[72019]: WARNING nova.compute.manager [req-e2f76de6-0876-4aa7-933e-ae09990d84c3 req-e16b909b-42cf-416a-ae77-66dea7cd4a65 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state active and task_state rebuilding.
Apr 14 13:21:18 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Successfully updated port: 4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "refresh_cache-21aa2e30-d383-4f3b-8c40-7a06968ecb8c" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquired lock "refresh_cache-21aa2e30-d383-4f3b-8c40-7a06968ecb8c" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-d0a07100-b159-4887-aaa8-7200e72bcf84 req-f2375673-6a99-44e8-9e59-3dcab78c99ba service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Received event network-changed-4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-d0a07100-b159-4887-aaa8-7200e72bcf84 req-f2375673-6a99-44e8-9e59-3dcab78c99ba service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Refreshing instance network info cache due to event network-changed-4ded420e-025f-481e-85a1-010b7e3d71f7. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d0a07100-b159-4887-aaa8-7200e72bcf84 req-f2375673-6a99-44e8-9e59-3dcab78c99ba service nova] Acquiring lock "refresh_cache-21aa2e30-d383-4f3b-8c40-7a06968ecb8c" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:21:18 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance destroyed successfully.
Apr 14 13:21:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1306609806',display_name='tempest-ServerActionsTestJSON-server-1057847197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1306609806',id=21,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:17:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-n0fqg6y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:21:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=6e646c88-579e-4ea1-b987-da1c7194a064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG os_vif [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25b21f1a-fb, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:21:18 user nova-compute[72019]: INFO os_vif [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb')
Apr 14 13:21:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGdkAJCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:18 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 13:21:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[87abd668-9032-497a-86ca-59d23262efca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:21:18 user nova-compute[72019]: No targets found.
Apr 14 13:21:18 user nova-compute[72019]: iSNS:
Apr 14 13:21:18 user nova-compute[72019]: No targets found.
Apr 14 13:21:18 user nova-compute[72019]: STATIC:
Apr 14 13:21:18 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:21:18 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:18 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:18 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507
Apr 14 13:21:18 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:18 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:18 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2
Apr 14 13:21:18 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:18 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:18 user nova-compute[72019]: FIRMWARE:
Apr 14 13:21:18 user nova-compute[72019]: No targets found.
Apr 14 13:21:18 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:21:18 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:21:18 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbf56c5-1484-4cdf-8180-15fc67661506]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[339a626f-a78c-45f2-8876-2f97e0e62d0e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:18 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:18 user nova-compute[72019]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 (non-flash)
Apr 14 13:21:18 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:18 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:18 user nova-compute[72019]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 (non-flash)
Apr 14 13:21:18 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74902e8670>, {}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Disconnecting from: [] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.099s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== disconnect_volume: return (101ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:21:18 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Deleting instance files /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064_del
Apr 14 13:21:18 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Deletion of /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064_del complete
Apr 14 13:21:19 user nova-compute[72019]: INFO nova.virt.block_device [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Booting with volume 0dc33843-6235-4794-844e-9fc4db46c60e at /dev/vdb
Apr 14 13:21:19 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Updating instance_info_cache with network_info: [{"id": "4ded420e-025f-481e-85a1-010b7e3d71f7", "address": "fa:16:3e:02:21:53", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ded420e-02", "ovs_interfaceid": "4ded420e-025f-481e-85a1-010b7e3d71f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG os_brick.utils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Releasing lock "refresh_cache-21aa2e30-d383-4f3b-8c40-7a06968ecb8c" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Instance network_info: |[{"id": "4ded420e-025f-481e-85a1-010b7e3d71f7", "address": "fa:16:3e:02:21:53", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ded420e-02", "ovs_interfaceid": "4ded420e-025f-481e-85a1-010b7e3d71f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56ae557-1744-4e12-b5f6-23bf8806a1d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d0a07100-b159-4887-aaa8-7200e72bcf84 req-f2375673-6a99-44e8-9e59-3dcab78c99ba service nova] Acquired lock "refresh_cache-21aa2e30-d383-4f3b-8c40-7a06968ecb8c" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG nova.network.neutron [req-d0a07100-b159-4887-aaa8-7200e72bcf84 req-f2375673-6a99-44e8-9e59-3dcab78c99ba service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Refreshing network info cache for port 4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8b7e61-aa62-40b2-b528-8ad3a606445c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[81960aa7-c9b2-48f2-b16f-92527aab5349]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd1148d-0199-4e6a-a8e8-d8329e3cb8dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:21:19 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[30723a5c-b209-45a2-8264-a4df2aa5b8dd]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG os_brick.utils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating existing volume attachment record: 447edcee-4fe3-44f8-8130-bc8483b2e365 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:21:19 user nova-compute[72019]: INFO nova.compute.manager [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Detaching volume 55eed418-6cb1-4596-aad1-2a05d54e57c2
Apr 14 13:21:19 user nova-compute[72019]: DEBUG nova.network.neutron [req-d0a07100-b159-4887-aaa8-7200e72bcf84 req-f2375673-6a99-44e8-9e59-3dcab78c99ba service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Updated VIF entry in instance network info cache for port 4ded420e-025f-481e-85a1-010b7e3d71f7. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG nova.network.neutron [req-d0a07100-b159-4887-aaa8-7200e72bcf84 req-f2375673-6a99-44e8-9e59-3dcab78c99ba service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Updating instance_info_cache with network_info: [{"id": "4ded420e-025f-481e-85a1-010b7e3d71f7", "address": "fa:16:3e:02:21:53", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ded420e-02", "ovs_interfaceid": "4ded420e-025f-481e-85a1-010b7e3d71f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:21:19 user nova-compute[72019]: INFO nova.virt.block_device [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Attempting to driver detach volume 55eed418-6cb1-4596-aad1-2a05d54e57c2 from mountpoint /dev/vdb
Apr 14 13:21:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d0a07100-b159-4887-aaa8-7200e72bcf84 req-f2375673-6a99-44e8-9e59-3dcab78c99ba service nova] Releasing lock "refresh_cache-21aa2e30-d383-4f3b-8c40-7a06968ecb8c" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Attempting to detach device vdb from instance dca3424c-cbca-4520-a495-8867c2a9c0c4 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:21:19 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:21:19 user nova-compute[72019]:   <source dev="/dev/sde"/>
Apr 14 13:21:19 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:21:19 user nova-compute[72019]:   <serial>55eed418-6cb1-4596-aad1-2a05d54e57c2</serial>
Apr 14 13:21:19 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:21:19 user nova-compute[72019]: </disk>
Apr 14 13:21:19 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:21:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Successfully detached device vdb from instance dca3424c-cbca-4520-a495-8867c2a9c0c4 from the persistent domain config.
Apr 14 13:21:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dca3424c-cbca-4520-a495-8867c2a9c0c4 from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:21:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:21:19 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:21:19 user nova-compute[72019]:   <source dev="/dev/sde"/>
Apr 14 13:21:19 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:21:19 user nova-compute[72019]:   <serial>55eed418-6cb1-4596-aad1-2a05d54e57c2</serial>
Apr 14 13:21:19 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:21:19 user nova-compute[72019]: </disk>
Apr 14 13:21:19 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478480.214476, dca3424c-cbca-4520-a495-8867c2a9c0c4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dca3424c-cbca-4520-a495-8867c2a9c0c4 {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:21:20 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Successfully detached device vdb from instance dca3424c-cbca-4520-a495-8867c2a9c0c4 from the live domain config.
Apr 14 13:21:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VmBepXEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:20 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e641220-2236-45af-a92d-ddbcf8c41697]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:21:20 user nova-compute[72019]: No targets found.
Apr 14 13:21:20 user nova-compute[72019]: iSNS:
Apr 14 13:21:20 user nova-compute[72019]: No targets found.
Apr 14 13:21:20 user nova-compute[72019]: STATIC:
Apr 14 13:21:20 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:21:20 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:20 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:20 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507
Apr 14 13:21:20 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:20 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:20 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2
Apr 14 13:21:20 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:20 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:20 user nova-compute[72019]: FIRMWARE:
Apr 14 13:21:20 user nova-compute[72019]: No targets found.
Apr 14 13:21:20 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:21:20 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:21:20 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec4e3fc-6574-41e9-a224-ef305d042c6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd64850b-0840-4d7c-bab6-2d67cf480183]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:20 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:20 user nova-compute[72019]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 (non-flash)
Apr 14 13:21:20 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:20 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:20 user nova-compute[72019]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 (non-flash)
Apr 14 13:21:20 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74902ea560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2'): ({'sde'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Removing single pathed devices sde {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaf4b6d-c1d0-490f-8551-1add2534c0a8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[307f2694-2026-444b-9829-64f5831fd403]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flushing IO for device /dev/sde {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[97219cf1-8ae5-4b5e-b826-5004092e557d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[324b18e4-d302-43d5-91ce-4cb39b8efc82]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[152ee6b1-4e14-4630-b91b-940d3aade657]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[194150f7-90a1-4d1b-9f4f-46a4a1bad7b8]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2, portal: 172.16.0.220,3260]
Apr 14 13:21:20 user nova-compute[72019]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2, portal: 172.16.0.220,3260] successful.
Apr 14 13:21:20 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eed418-6cb1-4596-aad1-2a05d54e57c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d1454a-7541-43bc-ac91-39778d311680]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] <== disconnect_volume: return (331ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:21:20 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:21:21 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'flavor' on Instance uuid dca3424c-cbca-4520-a495-8867c2a9c0c4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.759s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG os_brick.utils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a7105b-513c-49cd-bf3b-33e1015cca34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7426dd7-d254-4624-9a90-c22668a616a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[99108f43-5e17-48f1-b627-09fecf7ad296]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5013251-dd2a-470d-8e99-5bd099052195]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:21:22 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bf83dd-be8b-46ac-a7fc-27884c5f9d2f]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG os_brick.utils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Updating existing volume attachment record: 7e8a55fd-cd9a-414b-90b9-8a21f50e3c1c {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:21:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:21:23 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:21:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:21:24 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Creating image(s)
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "/opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "/opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.169s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:21:24 user nova-compute[72019]: INFO nova.compute.manager [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Unrescuing
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquired lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.149s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk 1073741824" returned: 0 in 0.067s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.144s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:21:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Cannot resize image /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Ensure instance console log exists: /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Start _get_guest_xml network_info=[{"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '447edcee-4fe3-44f8-8130-bc8483b2e365', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGdkAJCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6e646c88-579e-4ea1-b987-da1c7194a064', 'attached_at': '', 'detached_at': '', 'volume_id': '0dc33843-6235-4794-844e-9fc4db46c60e', 'serial': '0dc33843-6235-4794-844e-9fc4db46c60e'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:21:25 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 13:21:25 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.objects.instance [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGdkAJCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:25 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:25 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:25 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94a8991-33e4-484f-bbc1-7ec0372464e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:21:25 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb706c8-d577-4476-a21f-ef4c90823264]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e] added
Apr 14 13:21:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3b1954-7fdd-42d1-b0ef-fd8b037eeced]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[de86d954-b69a-4b05-a9ab-425518c51455]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGdkAJCg {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGdkAJCg" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aa2895-1557-4eed-ad9a-62e64c8a3053]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NGdkAJCg'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4203cf8c-8f40-4920-8d90-450d8eb234b2]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee86659-f070-446a-9a70-b1a0e18ce7f6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:25 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:25 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d53905-6c7e-474d-824f-f3fd219aa27e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260]
Apr 14 13:21:25 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260] successful.
Apr 14 13:21:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19f1dec-b148-4cf6-a9de-001ed02f52aa]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dea19aa-75bd-440e-b5fe-f30d2715c36a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:25 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:25 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:25 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:25 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.158s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b884d46-8fd2-4c30-a287-f33584f2b4b3]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: None {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Updating instance_info_cache with network_info: [{"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Releasing lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.objects.instance [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'flavor' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Updating instance_info_cache with network_info: [{"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:21:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-f51b9dcf-d4cb-4dff-9eed-a03d1f940116 req-efd5aecd-507b-473f-9a0f-33551faf982c service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-vif-unplugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f51b9dcf-d4cb-4dff-9eed-a03d1f940116 req-efd5aecd-507b-473f-9a0f-33551faf982c service nova] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f51b9dcf-d4cb-4dff-9eed-a03d1f940116 req-efd5aecd-507b-473f-9a0f-33551faf982c service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f51b9dcf-d4cb-4dff-9eed-a03d1f940116 req-efd5aecd-507b-473f-9a0f-33551faf982c service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-f51b9dcf-d4cb-4dff-9eed-a03d1f940116 req-efd5aecd-507b-473f-9a0f-33551faf982c service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] No waiting events found dispatching network-vif-unplugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:26 user nova-compute[72019]: WARNING nova.compute.manager [req-f51b9dcf-d4cb-4dff-9eed-a03d1f940116 req-efd5aecd-507b-473f-9a0f-33551faf982c service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received unexpected event network-vif-unplugged-965f15ad-1141-41f1-b9f3-41097bb21b5e for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-3e0150b6-3952-4912-91b7-f0e76cdbdd1c req-ffedd6a9-bb08-4829-b235-40a2bacaab99 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-changed-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-3e0150b6-3952-4912-91b7-f0e76cdbdd1c req-ffedd6a9-bb08-4829-b235-40a2bacaab99 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Refreshing instance network info cache due to event network-changed-965f15ad-1141-41f1-b9f3-41097bb21b5e. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3e0150b6-3952-4912-91b7-f0e76cdbdd1c req-ffedd6a9-bb08-4829-b235-40a2bacaab99 service nova] Acquiring lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3e0150b6-3952-4912-91b7-f0e76cdbdd1c req-ffedd6a9-bb08-4829-b235-40a2bacaab99 service nova] Acquired lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.network.neutron [req-3e0150b6-3952-4912-91b7-f0e76cdbdd1c req-ffedd6a9-bb08-4829-b235-40a2bacaab99 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Refreshing network info cache for port 965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGdkAJCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.511s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== connect_volume: return (1513ms) {'type': 'block', 'scsi_wwn': '26563623666303235', 'path': '/dev/sdd'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563623666303235', 'path': '/dev/sdd'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1306609806',display_name='tempest-ServerActionsTestJSON-server-1057847197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1306609806',id=21,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:17:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-n0fqg6y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=6e646c88-579e-4ea1-b987-da1c7194a064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:21:26 user nova-compute[72019]:   <uuid>6e646c88-579e-4ea1-b987-da1c7194a064</uuid>
Apr 14 13:21:26 user nova-compute[72019]:   <name>instance-00000015</name>
Apr 14 13:21:26 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:21:26 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:21:26 user nova-compute[72019]:   <metadata>
Apr 14 13:21:26 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:21:26 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:21:26 user nova-compute[72019]:       <nova:name>tempest-ServerActionsTestJSON-server-1057847197</nova:name>
Apr 14 13:21:26 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:21:25</nova:creationTime>
Apr 14 13:21:26 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:21:26 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:21:26 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:21:26 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:21:26 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:21:26 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:21:26 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:21:26 user nova-compute[72019]:       <nova:owner>
Apr 14 13:21:26 user nova-compute[72019]:         <nova:user uuid="9169729edbd04fd5a74d2cffd0aa437f">tempest-ServerActionsTestJSON-1929049437-project-member</nova:user>
Apr 14 13:21:26 user nova-compute[72019]:         <nova:project uuid="4b197f1df57f4dee9757639cf861eb97">tempest-ServerActionsTestJSON-1929049437</nova:project>
Apr 14 13:21:26 user nova-compute[72019]:       </nova:owner>
Apr 14 13:21:26 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:21:26 user nova-compute[72019]:       <nova:ports>
Apr 14 13:21:26 user nova-compute[72019]:         <nova:port uuid="25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7">
Apr 14 13:21:26 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 13:21:26 user nova-compute[72019]:         </nova:port>
Apr 14 13:21:26 user nova-compute[72019]:       </nova:ports>
Apr 14 13:21:26 user nova-compute[72019]:     </nova:instance>
Apr 14 13:21:26 user nova-compute[72019]:   </metadata>
Apr 14 13:21:26 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:21:26 user nova-compute[72019]:     <system>
Apr 14 13:21:26 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:21:26 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:21:26 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:21:26 user nova-compute[72019]:       <entry name="serial">6e646c88-579e-4ea1-b987-da1c7194a064</entry>
Apr 14 13:21:26 user nova-compute[72019]:       <entry name="uuid">6e646c88-579e-4ea1-b987-da1c7194a064</entry>
Apr 14 13:21:26 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:21:26 user nova-compute[72019]:     </system>
Apr 14 13:21:26 user nova-compute[72019]:   </sysinfo>
Apr 14 13:21:26 user nova-compute[72019]:   <os>
Apr 14 13:21:26 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:21:26 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:21:26 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:21:26 user nova-compute[72019]:   </os>
Apr 14 13:21:26 user nova-compute[72019]:   <features>
Apr 14 13:21:26 user nova-compute[72019]:     <acpi/>
Apr 14 13:21:26 user nova-compute[72019]:     <apic/>
Apr 14 13:21:26 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:21:26 user nova-compute[72019]:   </features>
Apr 14 13:21:26 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:21:26 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:21:26 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:21:26 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:21:26 user nova-compute[72019]:   </clock>
Apr 14 13:21:26 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:21:26 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:21:26 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:21:26 user nova-compute[72019]:   </cpu>
Apr 14 13:21:26 user nova-compute[72019]:   <devices>
Apr 14 13:21:26 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:21:26 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:21:26 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk"/>
Apr 14 13:21:26 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:21:26 user nova-compute[72019]:     </disk>
Apr 14 13:21:26 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:21:26 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:21:26 user nova-compute[72019]:       <source dev="/dev/sdd"/>
Apr 14 13:21:26 user nova-compute[72019]:       <target dev="vdb" bus="virtio"/>
Apr 14 13:21:26 user nova-compute[72019]:       <serial>0dc33843-6235-4794-844e-9fc4db46c60e</serial>
Apr 14 13:21:26 user nova-compute[72019]:     </disk>
Apr 14 13:21:26 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:21:26 user nova-compute[72019]:       <mac address="fa:16:3e:28:28:75"/>
Apr 14 13:21:26 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:21:26 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:21:26 user nova-compute[72019]:       <target dev="tap25b21f1a-fb"/>
Apr 14 13:21:26 user nova-compute[72019]:     </interface>
Apr 14 13:21:26 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:21:26 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/console.log" append="off"/>
Apr 14 13:21:26 user nova-compute[72019]:     </serial>
Apr 14 13:21:26 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:21:26 user nova-compute[72019]:     <video>
Apr 14 13:21:26 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:21:26 user nova-compute[72019]:     </video>
Apr 14 13:21:26 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:21:26 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:21:26 user nova-compute[72019]:     </rng>
Apr 14 13:21:26 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:21:26 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:21:26 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:21:26 user nova-compute[72019]:     </memballoon>
Apr 14 13:21:26 user nova-compute[72019]:   </devices>
Apr 14 13:21:26 user nova-compute[72019]: </domain>
Apr 14 13:21:26 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1306609806',display_name='tempest-ServerActionsTestJSON-server-1057847197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1306609806',id=21,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:17:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-n0fqg6y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=6e646c88-579e-4ea1-b987-da1c7194a064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG os_vif [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25b21f1a-fb, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25b21f1a-fb, col_values=(('external_ids', {'iface-id': '25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:28:75', 'vm-uuid': '6e646c88-579e-4ea1-b987-da1c7194a064'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:26 user nova-compute[72019]: INFO os_vif [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb')
Apr 14 13:21:26 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Instance destroyed successfully.
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No VIF found with MAC fa:16:3e:28:28:75, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:21:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.network.neutron [req-3e0150b6-3952-4912-91b7-f0e76cdbdd1c req-ffedd6a9-bb08-4829-b235-40a2bacaab99 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Updated VIF entry in instance network info cache for port 965f15ad-1141-41f1-b9f3-41097bb21b5e. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.network.neutron [req-3e0150b6-3952-4912-91b7-f0e76cdbdd1c req-ffedd6a9-bb08-4829-b235-40a2bacaab99 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Updating instance_info_cache with network_info: [{"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3e0150b6-3952-4912-91b7-f0e76cdbdd1c req-ffedd6a9-bb08-4829-b235-40a2bacaab99 service nova] Releasing lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:21:27 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Creating image(s)
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Ensure instance console log exists: /opt/stack/data/nova/instances/21aa2e30-d383-4f3b-8c40-7a06968ecb8c/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Start _get_guest_xml network_info=[{"id": "4ded420e-025f-481e-85a1-010b7e3d71f7", "address": "fa:16:3e:02:21:53", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ded420e-02", "ovs_interfaceid": "4ded420e-025f-481e-85a1-010b7e3d71f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '7e8a55fd-cd9a-414b-90b9-8a21f50e3c1c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLBMeSsb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '21aa2e30-d383-4f3b-8c40-7a06968ecb8c', 'attached_at': '', 'detached_at': '', 'volume_id': '4822856c-36c3-4353-ae82-bbd6804ded80', 'serial': '4822856c-36c3-4353-ae82-bbd6804ded80'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:21:27 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:21:27 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLBMeSsb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:27 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:27 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:27 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f45772-c01c-4ed6-9af2-f717c5305f7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:21:27 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26ff1eb-0473-4500-ae7f-b2980a2fb1fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80] added
Apr 14 13:21:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[500b5eb9-6b03-44f9-a815-a816885f30b8]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5c5d4d-3b4e-4e52-b056-36155bfd5746]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLBMeSsb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLBMeSsb" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bbd1d4-782a-42a8-ab2c-e7c857961ba6]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QLBMeSsb'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c57c6e-259f-49b9-8550-0ce9eddc9a70]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[473aef84-49f5-4bdf-8c8f-d8ee0bbc1ec0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:27 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:27 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:27 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:27 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b228d5d-a0c1-4a82-b7c7-b7dab99c4fb8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80, portal: 172.16.0.220,3260]
Apr 14 13:21:27 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80, portal: 172.16.0.220,3260] successful.
Apr 14 13:21:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b00990-91cd-40f1-aa04-c9419a046bb4]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[262797f6-6c4f-4ea1-b0a8-64a5dace289d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:27 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:27 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:27 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:21:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:27 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:27 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:27 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:21:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc181f0-9c64-4e9d-9086-7c78ad36d52e]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:21:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLBMeSsb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-d6a77b4c-4dca-426e-8667-f8ef5472479e req-f6ad69e4-ad38-455e-ba54-b166bc3c45b5 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d6a77b4c-4dca-426e-8667-f8ef5472479e req-f6ad69e4-ad38-455e-ba54-b166bc3c45b5 service nova] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d6a77b4c-4dca-426e-8667-f8ef5472479e req-f6ad69e4-ad38-455e-ba54-b166bc3c45b5 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d6a77b4c-4dca-426e-8667-f8ef5472479e req-f6ad69e4-ad38-455e-ba54-b166bc3c45b5 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-d6a77b4c-4dca-426e-8667-f8ef5472479e req-f6ad69e4-ad38-455e-ba54-b166bc3c45b5 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] No waiting events found dispatching network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:28 user nova-compute[72019]: WARNING nova.compute.manager [req-d6a77b4c-4dca-426e-8667-f8ef5472479e req-f6ad69e4-ad38-455e-ba54-b166bc3c45b5 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received unexpected event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-93b5166a-5996-4eb4-9b01-29ffbaaa3e5e req-5490fbbf-a63f-4fc8-b46d-55dd3f35575c service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-changed-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-93b5166a-5996-4eb4-9b01-29ffbaaa3e5e req-5490fbbf-a63f-4fc8-b46d-55dd3f35575c service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Refreshing instance network info cache due to event network-changed-965f15ad-1141-41f1-b9f3-41097bb21b5e. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-93b5166a-5996-4eb4-9b01-29ffbaaa3e5e req-5490fbbf-a63f-4fc8-b46d-55dd3f35575c service nova] Acquiring lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-93b5166a-5996-4eb4-9b01-29ffbaaa3e5e req-5490fbbf-a63f-4fc8-b46d-55dd3f35575c service nova] Acquired lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.network.neutron [req-93b5166a-5996-4eb4-9b01-29ffbaaa3e5e req-5490fbbf-a63f-4fc8-b46d-55dd3f35575c service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Refreshing network info cache for port 965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26661613738373664', 'path': '/dev/sde'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661613738373664', 'path': '/dev/sde'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-885871605',display_name='tempest-TestVolumeBootPattern-server-885871605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-885871605',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-nqr08png',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:21:16Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=21aa2e30-d383-4f3b-8c40-7a06968ecb8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ded420e-025f-481e-85a1-010b7e3d71f7", "address": "fa:16:3e:02:21:53", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ded420e-02", "ovs_interfaceid": "4ded420e-025f-481e-85a1-010b7e3d71f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "4ded420e-025f-481e-85a1-010b7e3d71f7", "address": "fa:16:3e:02:21:53", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ded420e-02", "ovs_interfaceid": "4ded420e-025f-481e-85a1-010b7e3d71f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:21:53,bridge_name='br-int',has_traffic_filtering=True,id=4ded420e-025f-481e-85a1-010b7e3d71f7,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ded420e-02') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.objects.instance [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lazy-loading 'pci_devices' on Instance uuid 21aa2e30-d383-4f3b-8c40-7a06968ecb8c {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:21:28 user nova-compute[72019]:   <uuid>21aa2e30-d383-4f3b-8c40-7a06968ecb8c</uuid>
Apr 14 13:21:28 user nova-compute[72019]:   <name>instance-0000001d</name>
Apr 14 13:21:28 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:21:28 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:21:28 user nova-compute[72019]:   <metadata>
Apr 14 13:21:28 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:21:28 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:21:28 user nova-compute[72019]:       <nova:name>tempest-TestVolumeBootPattern-server-885871605</nova:name>
Apr 14 13:21:28 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:21:27</nova:creationTime>
Apr 14 13:21:28 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:21:28 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:21:28 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:21:28 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:21:28 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:21:28 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:21:28 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:21:28 user nova-compute[72019]:       <nova:owner>
Apr 14 13:21:28 user nova-compute[72019]:         <nova:user uuid="bb40413bd0c3490d97b997f69c930f72">tempest-TestVolumeBootPattern-1645546988-project-member</nova:user>
Apr 14 13:21:28 user nova-compute[72019]:         <nova:project uuid="818de6fa330c4c87a3b6228345d9f13a">tempest-TestVolumeBootPattern-1645546988</nova:project>
Apr 14 13:21:28 user nova-compute[72019]:       </nova:owner>
Apr 14 13:21:28 user nova-compute[72019]:       <nova:ports>
Apr 14 13:21:28 user nova-compute[72019]:         <nova:port uuid="4ded420e-025f-481e-85a1-010b7e3d71f7">
Apr 14 13:21:28 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 13:21:28 user nova-compute[72019]:         </nova:port>
Apr 14 13:21:28 user nova-compute[72019]:       </nova:ports>
Apr 14 13:21:28 user nova-compute[72019]:     </nova:instance>
Apr 14 13:21:28 user nova-compute[72019]:   </metadata>
Apr 14 13:21:28 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:21:28 user nova-compute[72019]:     <system>
Apr 14 13:21:28 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:21:28 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:21:28 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:21:28 user nova-compute[72019]:       <entry name="serial">21aa2e30-d383-4f3b-8c40-7a06968ecb8c</entry>
Apr 14 13:21:28 user nova-compute[72019]:       <entry name="uuid">21aa2e30-d383-4f3b-8c40-7a06968ecb8c</entry>
Apr 14 13:21:28 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:21:28 user nova-compute[72019]:     </system>
Apr 14 13:21:28 user nova-compute[72019]:   </sysinfo>
Apr 14 13:21:28 user nova-compute[72019]:   <os>
Apr 14 13:21:28 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:21:28 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:21:28 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:21:28 user nova-compute[72019]:   </os>
Apr 14 13:21:28 user nova-compute[72019]:   <features>
Apr 14 13:21:28 user nova-compute[72019]:     <acpi/>
Apr 14 13:21:28 user nova-compute[72019]:     <apic/>
Apr 14 13:21:28 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:21:28 user nova-compute[72019]:   </features>
Apr 14 13:21:28 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:21:28 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:21:28 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:21:28 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:21:28 user nova-compute[72019]:   </clock>
Apr 14 13:21:28 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:21:28 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:21:28 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:21:28 user nova-compute[72019]:   </cpu>
Apr 14 13:21:28 user nova-compute[72019]:   <devices>
Apr 14 13:21:28 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:21:28 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:21:28 user nova-compute[72019]:       <source dev="/dev/sde"/>
Apr 14 13:21:28 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:21:28 user nova-compute[72019]:       <serial>4822856c-36c3-4353-ae82-bbd6804ded80</serial>
Apr 14 13:21:28 user nova-compute[72019]:     </disk>
Apr 14 13:21:28 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:21:28 user nova-compute[72019]:       <mac address="fa:16:3e:02:21:53"/>
Apr 14 13:21:28 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:21:28 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:21:28 user nova-compute[72019]:       <target dev="tap4ded420e-02"/>
Apr 14 13:21:28 user nova-compute[72019]:     </interface>
Apr 14 13:21:28 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:21:28 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/21aa2e30-d383-4f3b-8c40-7a06968ecb8c/console.log" append="off"/>
Apr 14 13:21:28 user nova-compute[72019]:     </serial>
Apr 14 13:21:28 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:21:28 user nova-compute[72019]:     <video>
Apr 14 13:21:28 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:21:28 user nova-compute[72019]:     </video>
Apr 14 13:21:28 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:21:28 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:21:28 user nova-compute[72019]:     </rng>
Apr 14 13:21:28 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:21:28 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:21:28 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:21:28 user nova-compute[72019]:     </memballoon>
Apr 14 13:21:28 user nova-compute[72019]:   </devices>
Apr 14 13:21:28 user nova-compute[72019]: </domain>
Apr 14 13:21:28 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-885871605',display_name='tempest-TestVolumeBootPattern-server-885871605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-885871605',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-nqr08png',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:21:16Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=21aa2e30-d383-4f3b-8c40-7a06968ecb8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ded420e-025f-481e-85a1-010b7e3d71f7", "address": "fa:16:3e:02:21:53", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ded420e-02", "ovs_interfaceid": "4ded420e-025f-481e-85a1-010b7e3d71f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "4ded420e-025f-481e-85a1-010b7e3d71f7", "address": "fa:16:3e:02:21:53", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ded420e-02", "ovs_interfaceid": "4ded420e-025f-481e-85a1-010b7e3d71f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:21:53,bridge_name='br-int',has_traffic_filtering=True,id=4ded420e-025f-481e-85a1-010b7e3d71f7,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ded420e-02') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG os_vif [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:21:53,bridge_name='br-int',has_traffic_filtering=True,id=4ded420e-025f-481e-85a1-010b7e3d71f7,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ded420e-02') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ded420e-02, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ded420e-02, col_values=(('external_ids', {'iface-id': '4ded420e-025f-481e-85a1-010b7e3d71f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:21:53', 'vm-uuid': '21aa2e30-d383-4f3b-8c40-7a06968ecb8c'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.network.neutron [req-93b5166a-5996-4eb4-9b01-29ffbaaa3e5e req-5490fbbf-a63f-4fc8-b46d-55dd3f35575c service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Updated VIF entry in instance network info cache for port 965f15ad-1141-41f1-b9f3-41097bb21b5e. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG nova.network.neutron [req-93b5166a-5996-4eb4-9b01-29ffbaaa3e5e req-5490fbbf-a63f-4fc8-b46d-55dd3f35575c service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Updating instance_info_cache with network_info: [{"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-93b5166a-5996-4eb4-9b01-29ffbaaa3e5e req-5490fbbf-a63f-4fc8-b46d-55dd3f35575c service nova] Releasing lock "refresh_cache-65e98ad1-3573-4dce-b9de-bbb1c36ed02e" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:21:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:28 user nova-compute[72019]: INFO os_vif [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:21:53,bridge_name='br-int',has_traffic_filtering=True,id=4ded420e-025f-481e-85a1-010b7e3d71f7,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ded420e-02')
Apr 14 13:21:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:21:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] No VIF found with MAC fa:16:3e:02:21:53, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:21:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] No waiting events found dispatching network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:30 user nova-compute[72019]: WARNING nova.compute.manager [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received unexpected event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:21:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] No waiting events found dispatching network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:30 user nova-compute[72019]: WARNING nova.compute.manager [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received unexpected event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:21:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG nova.compute.manager [req-dcd7c425-13a9-474b-baf8-7cae133af7c5 req-51ddb79c-7ed0-493e-8845-66731a1bc0da service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Received event network-vif-plugged-4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dcd7c425-13a9-474b-baf8-7cae133af7c5 req-51ddb79c-7ed0-493e-8845-66731a1bc0da service nova] Acquiring lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dcd7c425-13a9-474b-baf8-7cae133af7c5 req-51ddb79c-7ed0-493e-8845-66731a1bc0da service nova] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dcd7c425-13a9-474b-baf8-7cae133af7c5 req-51ddb79c-7ed0-493e-8845-66731a1bc0da service nova] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG nova.compute.manager [req-dcd7c425-13a9-474b-baf8-7cae133af7c5 req-51ddb79c-7ed0-493e-8845-66731a1bc0da service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] No waiting events found dispatching network-vif-plugged-4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:31 user nova-compute[72019]: WARNING nova.compute.manager [req-dcd7c425-13a9-474b-baf8-7cae133af7c5 req-51ddb79c-7ed0-493e-8845-66731a1bc0da service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Received unexpected event network-vif-plugged-4ded420e-025f-481e-85a1-010b7e3d71f7 for instance with vm_state building and task_state spawning.
Apr 14 13:21:31 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478476.7321212, 6e646c88-579e-4ea1-b987-da1c7194a064 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:21:31 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] VM Stopped (Lifecycle Event)
Apr 14 13:21:31 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d7b75de4-e1d0-4904-9af2-e3d602f00c45 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:32 user nova-compute[72019]: WARNING nova.compute.manager [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state active and task_state rebuild_spawning.
Apr 14 13:21:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:32 user nova-compute[72019]: WARNING nova.compute.manager [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state active and task_state rebuild_spawning.
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for 65e98ad1-3573-4dce-b9de-bbb1c36ed02e due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478492.8223913, 65e98ad1-3573-4dce-b9de-bbb1c36ed02e => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:21:32 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] VM Resumed (Lifecycle Event)
Apr 14 13:21:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:21:32 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 13:21:32 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478492.8227708, 65e98ad1-3573-4dce-b9de-bbb1c36ed02e => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:21:32 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] VM Started (Lifecycle Event)
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-c47b4896-1035-41ca-b692-0b393200096d req-3ae5cc86-66a4-4a89-8f74-ecb5876a0c55 service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Received event network-vif-plugged-4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c47b4896-1035-41ca-b692-0b393200096d req-3ae5cc86-66a4-4a89-8f74-ecb5876a0c55 service nova] Acquiring lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c47b4896-1035-41ca-b692-0b393200096d req-3ae5cc86-66a4-4a89-8f74-ecb5876a0c55 service nova] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c47b4896-1035-41ca-b692-0b393200096d req-3ae5cc86-66a4-4a89-8f74-ecb5876a0c55 service nova] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-c47b4896-1035-41ca-b692-0b393200096d req-3ae5cc86-66a4-4a89-8f74-ecb5876a0c55 service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] No waiting events found dispatching network-vif-plugged-4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:33 user nova-compute[72019]: WARNING nova.compute.manager [req-c47b4896-1035-41ca-b692-0b393200096d req-3ae5cc86-66a4-4a89-8f74-ecb5876a0c55 service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Received unexpected event network-vif-plugged-4ded420e-025f-481e-85a1-010b7e3d71f7 for instance with vm_state building and task_state spawning.
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478493.8155975, 6e646c88-579e-4ea1-b987-da1c7194a064 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:21:33 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] VM Resumed (Lifecycle Event)
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:21:33 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance spawned successfully.
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:33 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Instance spawned successfully.
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:33 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478493.8255002, 6e646c88-579e-4ea1-b987-da1c7194a064 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:21:33 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] VM Started (Lifecycle Event)
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:34 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 13:21:34 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478493.852323, 21aa2e30-d383-4f3b-8c40-7a06968ecb8c => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:21:34 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] VM Resumed (Lifecycle Event)
Apr 14 13:21:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:34 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:21:34 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478493.8570645, 21aa2e30-d383-4f3b-8c40-7a06968ecb8c => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:21:34 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] VM Started (Lifecycle Event)
Apr 14 13:21:34 user nova-compute[72019]: INFO nova.compute.manager [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Took 6.76 seconds to spawn the instance on the hypervisor.
Apr 14 13:21:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG nova.objects.instance [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72019) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:21:34 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:34 user nova-compute[72019]: INFO nova.compute.manager [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Unshelving
Apr 14 13:21:34 user nova-compute[72019]: INFO nova.compute.manager [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Took 18.85 seconds to build instance.
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.209s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.980s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.249s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:34 user nova-compute[72019]: INFO nova.virt.block_device [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Booting with volume 1fe1d12d-36df-40a9-a5dd-ce6280d95839 at /dev/vdc
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG os_brick.utils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee6cd58-6e29-4e42-9587-a03e821cc8f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc720cf-843a-436c-b278-4b7e6096d62d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60b1bd7-7553-4eb2-b3a7-7503bd38e7bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0c39a8-bef7-49f3-a32c-5dc3d6b149b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:21:35 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:21:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5f77f6-d7ee-4ac5-b79d-9a0af581dd85]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG os_brick.utils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] <== get_connector_properties: return (231ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updating existing volume attachment record: dce952db-20ff-436c-80d6-b2300291a3ed {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:21:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:21:36 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:21:36 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7754MB free_disk=26.224781036376953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 775293fc-1773-407d-bf49-fccfe849f440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:21:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:37 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:21:37 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:21:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:21:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.846s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:38 user nova-compute[72019]: INFO nova.compute.manager [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Rescuing
Apr 14 13:21:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:21:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquired lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:21:38 user nova-compute[72019]: DEBUG nova.network.neutron [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:21:38 user nova-compute[72019]: DEBUG nova.network.neutron [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Updating instance_info_cache with network_info: [{"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:21:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Releasing lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:21:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-01eea37f-baa8-46c4-9edd-0409774bfde7 req-4509e869-cf34-4c63-bee1-534000b70e44 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-vif-unplugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01eea37f-baa8-46c4-9edd-0409774bfde7 req-4509e869-cf34-4c63-bee1-534000b70e44 service nova] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01eea37f-baa8-46c4-9edd-0409774bfde7 req-4509e869-cf34-4c63-bee1-534000b70e44 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01eea37f-baa8-46c4-9edd-0409774bfde7 req-4509e869-cf34-4c63-bee1-534000b70e44 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-01eea37f-baa8-46c4-9edd-0409774bfde7 req-4509e869-cf34-4c63-bee1-534000b70e44 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] No waiting events found dispatching network-vif-unplugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:39 user nova-compute[72019]: WARNING nova.compute.manager [req-01eea37f-baa8-46c4-9edd-0409774bfde7 req-4509e869-cf34-4c63-bee1-534000b70e44 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received unexpected event network-vif-unplugged-c5258996-381d-45a2-8447-784b03a4e32e for instance with vm_state active and task_state rescuing.
Apr 14 13:21:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:39 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: b7cdf352-a517-4296-bc70-400836915095] Instance destroyed successfully.
Apr 14 13:21:39 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Attempting a stable device rescue
Apr 14 13:21:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72019) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 13:21:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Instance directory exists: not creating {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 13:21:39 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Creating image(s)
Apr 14 13:21:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "/opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "/opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:39 user nova-compute[72019]: DEBUG nova.objects.instance [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'trusted_certs' on Instance uuid b7cdf352-a517-4296-bc70-400836915095 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "a35c3dbefe7d5a48346626f36ba076328525428b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "a35c3dbefe7d5a48346626f36ba076328525428b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a35c3dbefe7d5a48346626f36ba076328525428b.part --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a35c3dbefe7d5a48346626f36ba076328525428b.part --force-share --output=json" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:40 user nova-compute[72019]: DEBUG nova.virt.images [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 7de2a88f-446d-4847-88b8-17bd32d4d517 was qcow2, converting to raw {{(pid=72019) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 13:21:40 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:21:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a35c3dbefe7d5a48346626f36ba076328525428b.part /opt/stack/data/nova/instances/_base/a35c3dbefe7d5a48346626f36ba076328525428b.converted {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG nova.objects.instance [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'pci_requests' on Instance uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-2582392f-1717-4ac6-8995-413371d7761b req-d9eb17e2-9f86-419a-b73f-eed61ee3630e service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2582392f-1717-4ac6-8995-413371d7761b req-d9eb17e2-9f86-419a-b73f-eed61ee3630e service nova] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2582392f-1717-4ac6-8995-413371d7761b req-d9eb17e2-9f86-419a-b73f-eed61ee3630e service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2582392f-1717-4ac6-8995-413371d7761b req-d9eb17e2-9f86-419a-b73f-eed61ee3630e service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-2582392f-1717-4ac6-8995-413371d7761b req-d9eb17e2-9f86-419a-b73f-eed61ee3630e service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] No waiting events found dispatching network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:41 user nova-compute[72019]: WARNING nova.compute.manager [req-2582392f-1717-4ac6-8995-413371d7761b req-d9eb17e2-9f86-419a-b73f-eed61ee3630e service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received unexpected event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e for instance with vm_state active and task_state rescuing.
Apr 14 13:21:41 user nova-compute[72019]: DEBUG nova.objects.instance [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'numa_topology' on Instance uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:21:41 user nova-compute[72019]: INFO nova.compute.claims [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Claim successful on node user
Apr 14 13:21:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a35c3dbefe7d5a48346626f36ba076328525428b.part /opt/stack/data/nova/instances/_base/a35c3dbefe7d5a48346626f36ba076328525428b.converted" returned: 0 in 0.788s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a35c3dbefe7d5a48346626f36ba076328525428b.converted --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a35c3dbefe7d5a48346626f36ba076328525428b.converted --force-share --output=json" returned: 0 in 0.160s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "a35c3dbefe7d5a48346626f36ba076328525428b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.041s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "a35c3dbefe7d5a48346626f36ba076328525428b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "a35c3dbefe7d5a48346626f36ba076328525428b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a35c3dbefe7d5a48346626f36ba076328525428b --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a35c3dbefe7d5a48346626f36ba076328525428b --force-share --output=json" returned: 0 in 0.154s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a35c3dbefe7d5a48346626f36ba076328525428b,backing_fmt=raw /opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095/disk.rescue {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a35c3dbefe7d5a48346626f36ba076328525428b,backing_fmt=raw /opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095/disk.rescue" returned: 0 in 0.055s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "a35c3dbefe7d5a48346626f36ba076328525428b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.objects.instance [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'migration_context' on Instance uuid b7cdf352-a517-4296-bc70-400836915095 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Start _get_guest_xml network_info=[{"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "vif_mac": "fa:16:3e:35:44:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7de2a88f-446d-4847-88b8-17bd32d4d517', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '6e3b6e3e-9801-4c8e-8753-9def5a5821a6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJSeHZPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'b7cdf352-a517-4296-bc70-400836915095', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa0a3b39-55d0-49c4-b1db-4792d0f556d6', 'serial': 'fa0a3b39-55d0-49c4-b1db-4792d0f556d6'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.objects.instance [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'resources' on Instance uuid b7cdf352-a517-4296-bc70-400836915095 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.objects.instance [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'numa_topology' on Instance uuid b7cdf352-a517-4296-bc70-400836915095 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:42 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:21:42 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.objects.instance [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'vcpu_model' on Instance uuid b7cdf352-a517-4296-bc70-400836915095 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJSeHZPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:42 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:42 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:42 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b153245-6e26-4c6e-a0ab-58523402890c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = OJSeHZPF\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 13:21:42 user nova-compute[72019]: node.name = iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:21:42 user nova-compute[72019]: node.tpgt = -1
Apr 14 13:21:42 user nova-compute[72019]: node.startup = automatic
Apr 14 13:21:42 user nova-compute[72019]: node.leading_login = No
Apr 14 13:21:42 user nova-compute[72019]: iface.iscsi_ifacename = default
Apr 14 13:21:42 user nova-compute[72019]: iface.net_ifacename = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.ipaddress = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.prefix_len = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.hwaddress = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.transport_name = tcp
Apr 14 13:21:42 user nova-compute[72019]: iface.initiatorname = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.state = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.vlan_id = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.vlan_priority = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.vlan_state = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.iface_num = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.mtu = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.port = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.bootproto = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.subnet_mask = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.gateway = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.dhcp_alt_client_id = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.dhcp_dns = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.dhcp_learn_iqn = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.dhcp_vendor_id_state = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.dhcp_vendor_id = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.dhcp_slp_da = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.fragmentation = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.gratuitous_arp = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.incoming_forwarding = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.tos_state = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.tos = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.ttl = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.delayed_ack = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.tcp_nagle = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.tcp_wsf_state = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.tcp_wsf = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.tcp_timer_scale = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.tcp_timestamp = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.redirect = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.def_task_mgmt_timeout = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.header_digest = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.data_digest = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.immediate_data = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.initial_r2t = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.data_seq_inorder = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.data_pdu_inorder = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.erl = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.max_receive_data_len = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.first_burst_len = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.max_outstanding_r2t = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.max_burst_len = 0
Apr 14 13:21:42 user nova-compute[72019]: iface.chap_auth = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.bidi_chap = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.strict_login_compliance = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.discovery_auth = <empty>
Apr 14 13:21:42 user nova-compute[72019]: iface.discovery_logout = <empty>
Apr 14 13:21:42 user nova-compute[72019]: node.discovery_address = <empty>
Apr 14 13:21:42 user nova-compute[72019]: node.discovery_port = 0
Apr 14 13:21:42 user nova-compute[72019]: node.discovery_type = static
Apr 14 13:21:42 user nova-compute[72019]: node.session.initial_cmdsn = 0
Apr 14 13:21:42 user nova-compute[72019]: node.session.initial_login_retry_max = 8
Apr 14 13:21:42 user nova-compute[72019]: node.session.xmit_thread_priority = -20
Apr 14 13:21:42 user nova-compute[72019]: node.session.cmds_max = 128
Apr 14 13:21:42 user nova-compute[72019]: node.session.queue_depth = 32
Apr 14 13:21:42 user nova-compute[72019]: node.session.nr_sessions = 1
Apr 14 13:21:42 user nova-compute[72019]: node.session.auth.authmethod = CHAP
Apr 14 13:21:42 user nova-compute[72019]: node.session.auth.username = OJSeHZPF
Apr 14 13:21:42 user nova-compute[72019]: node.session.auth.password = ***
Apr 14 13:21:42 user nova-compute[72019]: node.session.auth.username_in = <empty>
Apr 14 13:21:42 user nova-compute[72019]: node.session.auth.password_in = <empty>
Apr 14 13:21:42 user nova-compute[72019]: node.session.auth.chap_algs = MD5
Apr 14 13:21:42 user nova-compute[72019]: node.session.timeo.replacement_timeout = 120
Apr 14 13:21:42 user nova-compute[72019]: node.session.err_timeo.abort_timeout = 15
Apr 14 13:21:42 user nova-compute[72019]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 13:21:42 user nova-compute[72019]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 13:21:42 user nova-compute[72019]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 13:21:42 user nova-compute[72019]: node.session.iscsi.FastAbort = Yes
Apr 14 13:21:42 user nova-compute[72019]: node.session.iscsi.InitialR2T = No
Apr 14 13:21:42 user nova-compute[72019]: node.session.iscsi.ImmediateData = Yes
Apr 14 13:21:42 user nova-compute[72019]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 13:21:42 user nova-compute[72019]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 13:21:42 user nova-compute[72019]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 13:21:42 user nova-compute[72019]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 13:21:42 user nova-compute[72019]: node.session.iscsi.MaxConnections = 1
Apr 14 13:21:42 user nova-compute[72019]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 13:21:42 user nova-compute[72019]: node.session.iscsi.ERL = 0
Apr 14 13:21:42 user nova-compute[72019]: node.session.scan = manual
Apr 14 13:21:42 user nova-compute[72019]: node.session.reopen_max = 0
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].address = 172.16.0.220
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].port = 3260
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].startup = manual
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].tcp.window_size = 524288
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].tcp.type_of_service = 0
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].timeo.logout_timeout = 15
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].timeo.login_timeout = 15
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].timeo.auth_timeout = 45
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].iscsi.DataDigest = None
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].iscsi.IFMarker = No
Apr 14 13:21:42 user nova-compute[72019]: node.conn[0].iscsi.OFMarker = No
Apr 14 13:21:42 user nova-compute[72019]: # END RECORD
Apr 14 13:21:42 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e758bb-742f-48ea-b759-1e0464ee66f1]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ea2b69-b6dd-4cf0-9de6-968f58d92490]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OJSeHZPF {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OJSeHZPF" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c033c706-0f3e-4e58-bd88-566357704f93]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OJSeHZPF'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5659c60e-877b-4de4-86e7-24d8374c78bc]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.157s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[32199bd5-2827-4b5b-82d2-fa1b15f787aa]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:42 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:42 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:42 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:21:42 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:42 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:42 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:42 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:21:42 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.174s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] HCTL ('34', '0', '0', 0) found on session 22 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96fd391-0b2d-4b9f-b55c-ad0d86fcd9a3]: (4, ('0 0 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Searching for a device in session 22 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJSeHZPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.204s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] <== connect_volume: return (206ms) {'type': 'block', 'scsi_wwn': '26530623034653063', 'path': '/dev/sdc'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530623034653063', 'path': '/dev/sdc'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1188690873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1188690873',id=27,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:20:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a573d19b775642bba2f2883e0005492d',ramdisk_id='',reservation_id='r-rm54dxhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-740277424',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:20:03Z,user_data=None,user_id='ebc2d46bc1794568841df20b046356c7',uuid=b7cdf352-a517-4296-bc70-400836915095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "vif_mac": "fa:16:3e:35:44:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converting VIF {"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "vif_mac": "fa:16:3e:35:44:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:44:e4,bridge_name='br-int',has_traffic_filtering=True,id=c5258996-381d-45a2-8447-784b03a4e32e,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5258996-38') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.objects.instance [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'pci_devices' on Instance uuid b7cdf352-a517-4296-bc70-400836915095 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:21:42 user nova-compute[72019]:   <uuid>b7cdf352-a517-4296-bc70-400836915095</uuid>
Apr 14 13:21:42 user nova-compute[72019]:   <name>instance-0000001b</name>
Apr 14 13:21:42 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:21:42 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:21:42 user nova-compute[72019]:   <metadata>
Apr 14 13:21:42 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:21:42 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:21:42 user nova-compute[72019]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1188690873</nova:name>
Apr 14 13:21:42 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:21:42</nova:creationTime>
Apr 14 13:21:42 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:21:42 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:21:42 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:21:42 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:21:42 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:21:42 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:21:42 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:21:42 user nova-compute[72019]:       <nova:owner>
Apr 14 13:21:42 user nova-compute[72019]:         <nova:user uuid="ebc2d46bc1794568841df20b046356c7">tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member</nova:user>
Apr 14 13:21:42 user nova-compute[72019]:         <nova:project uuid="a573d19b775642bba2f2883e0005492d">tempest-ServerBootFromVolumeStableRescueTest-740277424</nova:project>
Apr 14 13:21:42 user nova-compute[72019]:       </nova:owner>
Apr 14 13:21:42 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:21:42 user nova-compute[72019]:       <nova:ports>
Apr 14 13:21:42 user nova-compute[72019]:         <nova:port uuid="c5258996-381d-45a2-8447-784b03a4e32e">
Apr 14 13:21:42 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 13:21:42 user nova-compute[72019]:         </nova:port>
Apr 14 13:21:42 user nova-compute[72019]:       </nova:ports>
Apr 14 13:21:42 user nova-compute[72019]:     </nova:instance>
Apr 14 13:21:42 user nova-compute[72019]:   </metadata>
Apr 14 13:21:42 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:21:42 user nova-compute[72019]:     <system>
Apr 14 13:21:42 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:21:42 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:21:42 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:21:42 user nova-compute[72019]:       <entry name="serial">b7cdf352-a517-4296-bc70-400836915095</entry>
Apr 14 13:21:42 user nova-compute[72019]:       <entry name="uuid">b7cdf352-a517-4296-bc70-400836915095</entry>
Apr 14 13:21:42 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:21:42 user nova-compute[72019]:     </system>
Apr 14 13:21:42 user nova-compute[72019]:   </sysinfo>
Apr 14 13:21:42 user nova-compute[72019]:   <os>
Apr 14 13:21:42 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:21:42 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:21:42 user nova-compute[72019]:   </os>
Apr 14 13:21:42 user nova-compute[72019]:   <features>
Apr 14 13:21:42 user nova-compute[72019]:     <acpi/>
Apr 14 13:21:42 user nova-compute[72019]:     <apic/>
Apr 14 13:21:42 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:21:42 user nova-compute[72019]:   </features>
Apr 14 13:21:42 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:21:42 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:21:42 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:21:42 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:21:42 user nova-compute[72019]:   </clock>
Apr 14 13:21:42 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:21:42 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:21:42 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:21:42 user nova-compute[72019]:   </cpu>
Apr 14 13:21:42 user nova-compute[72019]:   <devices>
Apr 14 13:21:42 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:21:42 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:21:42 user nova-compute[72019]:       <source dev="/dev/sdc"/>
Apr 14 13:21:42 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:21:42 user nova-compute[72019]:       <serial>fa0a3b39-55d0-49c4-b1db-4792d0f556d6</serial>
Apr 14 13:21:42 user nova-compute[72019]:     </disk>
Apr 14 13:21:42 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:21:42 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:21:42 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095/disk.rescue"/>
Apr 14 13:21:42 user nova-compute[72019]:       <target dev="vdb" bus="virtio"/>
Apr 14 13:21:42 user nova-compute[72019]:       <boot order="1"/>
Apr 14 13:21:42 user nova-compute[72019]:     </disk>
Apr 14 13:21:42 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:21:42 user nova-compute[72019]:       <mac address="fa:16:3e:35:44:e4"/>
Apr 14 13:21:42 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:21:42 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:21:42 user nova-compute[72019]:       <target dev="tapc5258996-38"/>
Apr 14 13:21:42 user nova-compute[72019]:     </interface>
Apr 14 13:21:42 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:21:42 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095/console.log" append="off"/>
Apr 14 13:21:42 user nova-compute[72019]:     </serial>
Apr 14 13:21:42 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:21:42 user nova-compute[72019]:     <video>
Apr 14 13:21:42 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:21:42 user nova-compute[72019]:     </video>
Apr 14 13:21:42 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:21:42 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:21:42 user nova-compute[72019]:     </rng>
Apr 14 13:21:42 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:21:42 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:21:42 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:21:42 user nova-compute[72019]:     </memballoon>
Apr 14 13:21:42 user nova-compute[72019]:   </devices>
Apr 14 13:21:42 user nova-compute[72019]: </domain>
Apr 14 13:21:42 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:21:42 user nova-compute[72019]: INFO nova.network.neutron [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updating port 351008cc-2fb2-4fa8-997d-96ea40263d9d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 13:21:42 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: b7cdf352-a517-4296-bc70-400836915095] Instance destroyed successfully.
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:21:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] No VIF found with MAC fa:16:3e:35:44:e4, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:21:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:21:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquired lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:21:43 user nova-compute[72019]: DEBUG nova.network.neutron [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:21:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-50656481-4867-4eae-9ac5-a92571a6fd18 req-18b19315-7c33-4f30-ad3f-38c330e09e0e service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-changed-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-50656481-4867-4eae-9ac5-a92571a6fd18 req-18b19315-7c33-4f30-ad3f-38c330e09e0e service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Refreshing instance network info cache due to event network-changed-351008cc-2fb2-4fa8-997d-96ea40263d9d. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:21:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-50656481-4867-4eae-9ac5-a92571a6fd18 req-18b19315-7c33-4f30-ad3f-38c330e09e0e service nova] Acquiring lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:21:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG nova.network.neutron [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updating instance_info_cache with network_info: [{"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG nova.compute.manager [req-787717a8-2eae-42cb-8960-8fb7bec13efb req-1acfb0a5-6275-4a68-81fc-096e89a5df62 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-787717a8-2eae-42cb-8960-8fb7bec13efb req-1acfb0a5-6275-4a68-81fc-096e89a5df62 service nova] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-787717a8-2eae-42cb-8960-8fb7bec13efb req-1acfb0a5-6275-4a68-81fc-096e89a5df62 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-787717a8-2eae-42cb-8960-8fb7bec13efb req-1acfb0a5-6275-4a68-81fc-096e89a5df62 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG nova.compute.manager [req-787717a8-2eae-42cb-8960-8fb7bec13efb req-1acfb0a5-6275-4a68-81fc-096e89a5df62 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] No waiting events found dispatching network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:44 user nova-compute[72019]: WARNING nova.compute.manager [req-787717a8-2eae-42cb-8960-8fb7bec13efb req-1acfb0a5-6275-4a68-81fc-096e89a5df62 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received unexpected event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e for instance with vm_state active and task_state rescuing.
Apr 14 13:21:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Releasing lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:21:44 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Creating image(s)
Apr 14 13:21:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "/opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "/opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG nova.objects.instance [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-50656481-4867-4eae-9ac5-a92571a6fd18 req-18b19315-7c33-4f30-ad3f-38c330e09e0e service nova] Acquired lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG nova.network.neutron [req-50656481-4867-4eae-9ac5-a92571a6fd18 req-18b19315-7c33-4f30-ad3f-38c330e09e0e service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Refreshing network info cache for port 351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "0d03a40325491fdb6a9c4f293459a839b87dd66f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "0d03a40325491fdb6a9c4f293459a839b87dd66f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f.part --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f.part --force-share --output=json" returned: 0 in 0.167s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:45 user nova-compute[72019]: DEBUG nova.virt.images [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 38ad7f16-bf0d-4451-8988-65cefed93769 was qcow2, converting to raw {{(pid=72019) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 13:21:45 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:21:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f.part /opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f.converted {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG nova.network.neutron [req-50656481-4867-4eae-9ac5-a92571a6fd18 req-18b19315-7c33-4f30-ad3f-38c330e09e0e service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updated VIF entry in instance network info cache for port 351008cc-2fb2-4fa8-997d-96ea40263d9d. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG nova.network.neutron [req-50656481-4867-4eae-9ac5-a92571a6fd18 req-18b19315-7c33-4f30-ad3f-38c330e09e0e service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updating instance_info_cache with network_info: [{"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-50656481-4867-4eae-9ac5-a92571a6fd18 req-18b19315-7c33-4f30-ad3f-38c330e09e0e service nova] Releasing lock "refresh_cache-1a866f3f-b709-4286-8cef-8e3b35f26d0b" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f.part /opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f.converted" returned: 0 in 0.380s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f.converted --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f.converted --force-share --output=json" returned: 0 in 0.159s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "0d03a40325491fdb6a9c4f293459a839b87dd66f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.824s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f --force-share --output=json" returned: 0 in 0.171s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "0d03a40325491fdb6a9c4f293459a839b87dd66f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "0d03a40325491fdb6a9c4f293459a839b87dd66f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG nova.compute.manager [req-3dd5bb16-a4e6-4055-8ffc-319602473c61 req-c38342ce-3eda-4650-935f-a6756c59f319 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3dd5bb16-a4e6-4055-8ffc-319602473c61 req-c38342ce-3eda-4650-935f-a6756c59f319 service nova] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3dd5bb16-a4e6-4055-8ffc-319602473c61 req-c38342ce-3eda-4650-935f-a6756c59f319 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3dd5bb16-a4e6-4055-8ffc-319602473c61 req-c38342ce-3eda-4650-935f-a6756c59f319 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG nova.compute.manager [req-3dd5bb16-a4e6-4055-8ffc-319602473c61 req-c38342ce-3eda-4650-935f-a6756c59f319 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] No waiting events found dispatching network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:46 user nova-compute[72019]: WARNING nova.compute.manager [req-3dd5bb16-a4e6-4055-8ffc-319602473c61 req-c38342ce-3eda-4650-935f-a6756c59f319 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received unexpected event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e for instance with vm_state active and task_state rescuing.
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f --force-share --output=json" returned: 0 in 0.147s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f,backing_fmt=raw /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f,backing_fmt=raw /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk 1073741824" returned: 0 in 0.057s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "0d03a40325491fdb6a9c4f293459a839b87dd66f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d03a40325491fdb6a9c4f293459a839b87dd66f --force-share --output=json" returned: 0 in 0.162s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG nova.objects.instance [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'migration_context' on Instance uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for b7cdf352-a517-4296-bc70-400836915095 due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478506.8814352, b7cdf352-a517-4296-bc70-400836915095 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:21:46 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] VM Resumed (Lifecycle Event)
Apr 14 13:21:46 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Rebasing disk image.
Apr 14 13:21:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:21:47 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 13:21:47 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478506.8885787, b7cdf352-a517-4296-bc70-400836915095 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:21:47 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] VM Started (Lifecycle Event)
Apr 14 13:21:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:21:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.156s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:47 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d -F raw /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d -F raw /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk" returned: 0 in 3.439s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Ensure instance console log exists: /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Start _get_guest_xml network_info=[{"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='6755d2897477feb7edd5c879039f42e3',container_format='bare',created_at=2023-04-14T13:19:41Z,direct_url=<?>,disk_format='qcow2',id=38ad7f16-bf0d-4451-8988-65cefed93769,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2054124847-shelved',owner='8f0fee50983a4e31b1689dc77b1c4db1',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T13:19:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'dce952db-20ff-436c-80d6-b2300291a3ed', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWZgdINz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '1a866f3f-b709-4286-8cef-8e3b35f26d0b', 'attached_at': '', 'detached_at': '', 'volume_id': '1fe1d12d-36df-40a9-a5dd-ce6280d95839', 'serial': '1fe1d12d-36df-40a9-a5dd-ce6280d95839'}, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:21:50 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:21:50 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6755d2897477feb7edd5c879039f42e3',container_format='bare',created_at=2023-04-14T13:19:41Z,direct_url=<?>,disk_format='qcow2',id=38ad7f16-bf0d-4451-8988-65cefed93769,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2054124847-shelved',owner='8f0fee50983a4e31b1689dc77b1c4db1',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T13:19:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.objects.instance [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWZgdINz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:50 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:50 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:50 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[128139b5-e074-4573-b73f-e4873ae9818c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:21:50 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c36d127-044a-4a96-94ae-0a323285d549]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839] added
Apr 14 13:21:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2468bae5-54b7-48c9-9399-17b06eb2f6cf]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9e44fd-fec0-4b65-8018-d8b51d6dda57]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yWZgdINz {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yWZgdINz" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c261c5-181b-4f09-9740-e1f22c98eb1b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yWZgdINz'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb55bf93-3505-43cb-aa5b-8913fa313197]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb097cc8-1780-4676-a403-360e58880adc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:50 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:50 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:50 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:21:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:50 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:50 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:50 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:21:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d6ab55-5e5f-4c55-8a09-d9f9b0539a2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839, portal: 172.16.0.220,3260]
Apr 14 13:21:50 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839, portal: 172.16.0.220,3260] successful.
Apr 14 13:21:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[144c4e7b-0d0d-4225-acbb-ab9dfed5bb44]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:51 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1094d047-4848-4110-a23c-609582d231ef]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:51 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:51 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:51 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:21:51 user nova-compute[72019]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)
Apr 14 13:21:51 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:51 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:51 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:51 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:21:51 user nova-compute[72019]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)
Apr 14 13:21:51 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:21:51 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:21:51 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:21:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:51 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dcf3e3-26aa-41cc-82f0-5f4612f011f9]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:51 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:21:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWZgdINz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:21:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '23661353763663631', 'path': '/dev/sdf'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661353763663631', 'path': '/dev/sdf'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2054124847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2054124847',id=23,image_ref='38ad7f16-bf0d-4451-8988-65cefed93769',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1859762998',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:17:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8f0fee50983a4e31b1689dc77b1c4db1',ramdisk_id='',reservation_id='r-bh3fqraz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1344633518',owner_user_name='tempest-AttachVolumeShelveTestJSON-1344633518-project-member',shelved_at='2023-04-14T13:19:45.515272',shelved_host='user',shelved_image_id='38ad7f16-bf0d-4451-8988-65cefed93769'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:21:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04370605aec40a0a53a080c1e8bf8a8',uuid=1a866f3f-b709-4286-8cef-8e3b35f26d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converting VIF {"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:74:1b,bridge_name='br-int',has_traffic_filtering=True,id=351008cc-2fb2-4fa8-997d-96ea40263d9d,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351008cc-2f') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG nova.objects.instance [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:21:52 user nova-compute[72019]:   <uuid>1a866f3f-b709-4286-8cef-8e3b35f26d0b</uuid>
Apr 14 13:21:52 user nova-compute[72019]:   <name>instance-00000017</name>
Apr 14 13:21:52 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:21:52 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:21:52 user nova-compute[72019]:   <metadata>
Apr 14 13:21:52 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:21:52 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:21:52 user nova-compute[72019]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2054124847</nova:name>
Apr 14 13:21:52 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:21:50</nova:creationTime>
Apr 14 13:21:52 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:21:52 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:21:52 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:21:52 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:21:52 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:21:52 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:21:52 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:21:52 user nova-compute[72019]:       <nova:owner>
Apr 14 13:21:52 user nova-compute[72019]:         <nova:user uuid="f04370605aec40a0a53a080c1e8bf8a8">tempest-AttachVolumeShelveTestJSON-1344633518-project-member</nova:user>
Apr 14 13:21:52 user nova-compute[72019]:         <nova:project uuid="8f0fee50983a4e31b1689dc77b1c4db1">tempest-AttachVolumeShelveTestJSON-1344633518</nova:project>
Apr 14 13:21:52 user nova-compute[72019]:       </nova:owner>
Apr 14 13:21:52 user nova-compute[72019]:       <nova:root type="image" uuid="38ad7f16-bf0d-4451-8988-65cefed93769"/>
Apr 14 13:21:52 user nova-compute[72019]:       <nova:ports>
Apr 14 13:21:52 user nova-compute[72019]:         <nova:port uuid="351008cc-2fb2-4fa8-997d-96ea40263d9d">
Apr 14 13:21:52 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 13:21:52 user nova-compute[72019]:         </nova:port>
Apr 14 13:21:52 user nova-compute[72019]:       </nova:ports>
Apr 14 13:21:52 user nova-compute[72019]:     </nova:instance>
Apr 14 13:21:52 user nova-compute[72019]:   </metadata>
Apr 14 13:21:52 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:21:52 user nova-compute[72019]:     <system>
Apr 14 13:21:52 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:21:52 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:21:52 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:21:52 user nova-compute[72019]:       <entry name="serial">1a866f3f-b709-4286-8cef-8e3b35f26d0b</entry>
Apr 14 13:21:52 user nova-compute[72019]:       <entry name="uuid">1a866f3f-b709-4286-8cef-8e3b35f26d0b</entry>
Apr 14 13:21:52 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:21:52 user nova-compute[72019]:     </system>
Apr 14 13:21:52 user nova-compute[72019]:   </sysinfo>
Apr 14 13:21:52 user nova-compute[72019]:   <os>
Apr 14 13:21:52 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:21:52 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:21:52 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:21:52 user nova-compute[72019]:   </os>
Apr 14 13:21:52 user nova-compute[72019]:   <features>
Apr 14 13:21:52 user nova-compute[72019]:     <acpi/>
Apr 14 13:21:52 user nova-compute[72019]:     <apic/>
Apr 14 13:21:52 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:21:52 user nova-compute[72019]:   </features>
Apr 14 13:21:52 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:21:52 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:21:52 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:21:52 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:21:52 user nova-compute[72019]:   </clock>
Apr 14 13:21:52 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:21:52 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:21:52 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:21:52 user nova-compute[72019]:   </cpu>
Apr 14 13:21:52 user nova-compute[72019]:   <devices>
Apr 14 13:21:52 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:21:52 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:21:52 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk"/>
Apr 14 13:21:52 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:21:52 user nova-compute[72019]:     </disk>
Apr 14 13:21:52 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:21:52 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:21:52 user nova-compute[72019]:       <source dev="/dev/sdf"/>
Apr 14 13:21:52 user nova-compute[72019]:       <target dev="vdc" bus="virtio"/>
Apr 14 13:21:52 user nova-compute[72019]:       <serial>1fe1d12d-36df-40a9-a5dd-ce6280d95839</serial>
Apr 14 13:21:52 user nova-compute[72019]:     </disk>
Apr 14 13:21:52 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:21:52 user nova-compute[72019]:       <mac address="fa:16:3e:45:74:1b"/>
Apr 14 13:21:52 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:21:52 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:21:52 user nova-compute[72019]:       <target dev="tap351008cc-2f"/>
Apr 14 13:21:52 user nova-compute[72019]:     </interface>
Apr 14 13:21:52 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:21:52 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/console.log" append="off"/>
Apr 14 13:21:52 user nova-compute[72019]:     </serial>
Apr 14 13:21:52 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:21:52 user nova-compute[72019]:     <video>
Apr 14 13:21:52 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:21:52 user nova-compute[72019]:     </video>
Apr 14 13:21:52 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:21:52 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:21:52 user nova-compute[72019]:     </rng>
Apr 14 13:21:52 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:21:52 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:21:52 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:21:52 user nova-compute[72019]:     </memballoon>
Apr 14 13:21:52 user nova-compute[72019]:   </devices>
Apr 14 13:21:52 user nova-compute[72019]: </domain>
Apr 14 13:21:52 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2054124847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2054124847',id=23,image_ref='38ad7f16-bf0d-4451-8988-65cefed93769',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1859762998',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:17:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8f0fee50983a4e31b1689dc77b1c4db1',ramdisk_id='',reservation_id='r-bh3fqraz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1344633518',owner_user_name='tempest-AttachVolumeShelveTestJSON-1344633518-project-member',shelved_at='2023-04-14T13:19:45.515272',shelved_host='user',shelved_image_id='38ad7f16-bf0d-4451-8988-65cefed93769'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:21:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04370605aec40a0a53a080c1e8bf8a8',uuid=1a866f3f-b709-4286-8cef-8e3b35f26d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converting VIF {"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:74:1b,bridge_name='br-int',has_traffic_filtering=True,id=351008cc-2fb2-4fa8-997d-96ea40263d9d,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351008cc-2f') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG os_vif [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:74:1b,bridge_name='br-int',has_traffic_filtering=True,id=351008cc-2fb2-4fa8-997d-96ea40263d9d,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351008cc-2f') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap351008cc-2f, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap351008cc-2f, col_values=(('external_ids', {'iface-id': '351008cc-2fb2-4fa8-997d-96ea40263d9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:74:1b', 'vm-uuid': '1a866f3f-b709-4286-8cef-8e3b35f26d0b'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:52 user nova-compute[72019]: INFO os_vif [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:74:1b,bridge_name='br-int',has_traffic_filtering=True,id=351008cc-2fb2-4fa8-997d-96ea40263d9d,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351008cc-2f')
Apr 14 13:21:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:21:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] No VIF found with MAC fa:16:3e:45:74:1b, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:21:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-0a118b21-e1e2-4214-8156-be5fd777e807 req-f683dfe8-9e80-4d7f-94b4-3a83d4bbe968 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0a118b21-e1e2-4214-8156-be5fd777e807 req-f683dfe8-9e80-4d7f-94b4-3a83d4bbe968 service nova] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0a118b21-e1e2-4214-8156-be5fd777e807 req-f683dfe8-9e80-4d7f-94b4-3a83d4bbe968 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0a118b21-e1e2-4214-8156-be5fd777e807 req-f683dfe8-9e80-4d7f-94b4-3a83d4bbe968 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-0a118b21-e1e2-4214-8156-be5fd777e807 req-f683dfe8-9e80-4d7f-94b4-3a83d4bbe968 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] No waiting events found dispatching network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:54 user nova-compute[72019]: WARNING nova.compute.manager [req-0a118b21-e1e2-4214-8156-be5fd777e807 req-f683dfe8-9e80-4d7f-94b4-3a83d4bbe968 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received unexpected event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 13:21:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-f8164ae6-689a-47ac-94b1-0d19033c24d9 req-a9c91629-deb0-418a-9ca0-09016b8c5ef7 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f8164ae6-689a-47ac-94b1-0d19033c24d9 req-a9c91629-deb0-418a-9ca0-09016b8c5ef7 service nova] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f8164ae6-689a-47ac-94b1-0d19033c24d9 req-a9c91629-deb0-418a-9ca0-09016b8c5ef7 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f8164ae6-689a-47ac-94b1-0d19033c24d9 req-a9c91629-deb0-418a-9ca0-09016b8c5ef7 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-f8164ae6-689a-47ac-94b1-0d19033c24d9 req-a9c91629-deb0-418a-9ca0-09016b8c5ef7 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] No waiting events found dispatching network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:56 user nova-compute[72019]: WARNING nova.compute.manager [req-f8164ae6-689a-47ac-94b1-0d19033c24d9 req-a9c91629-deb0-418a-9ca0-09016b8c5ef7 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received unexpected event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 13:21:56 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478516.253421, 1a866f3f-b709-4286-8cef-8e3b35f26d0b => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:21:56 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] VM Resumed (Lifecycle Event)
Apr 14 13:21:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:21:56 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Instance spawned successfully.
Apr 14 13:21:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:21:56 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:21:56 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478516.253587, 1a866f3f-b709-4286-8cef-8e3b35f26d0b => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:21:56 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] VM Started (Lifecycle Event)
Apr 14 13:21:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:21:56 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:21:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.161s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:56 user nova-compute[72019]: INFO nova.compute.manager [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Terminating instance
Apr 14 13:21:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-6c47112f-322e-47b2-9111-e580021f8116 req-807ab95d-2586-4d04-b143-f30dfe0077d3 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-vif-unplugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6c47112f-322e-47b2-9111-e580021f8116 req-807ab95d-2586-4d04-b143-f30dfe0077d3 service nova] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6c47112f-322e-47b2-9111-e580021f8116 req-807ab95d-2586-4d04-b143-f30dfe0077d3 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6c47112f-322e-47b2-9111-e580021f8116 req-807ab95d-2586-4d04-b143-f30dfe0077d3 service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-6c47112f-322e-47b2-9111-e580021f8116 req-807ab95d-2586-4d04-b143-f30dfe0077d3 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] No waiting events found dispatching network-vif-unplugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-6c47112f-322e-47b2-9111-e580021f8116 req-807ab95d-2586-4d04-b143-f30dfe0077d3 service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-vif-unplugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:21:57 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Instance destroyed successfully.
Apr 14 13:21:57 user nova-compute[72019]: DEBUG nova.objects.instance [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'resources' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-303889780',display_name='tempest-AttachVolumeTestJSON-server-303889780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-303889780',id=2,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/dvc2S0OuXcn9jdXIUza2Um4pu7uvo7HYOG07F6fnb37QHZ7NdhG6QTqMXI3jbPISSO6VjhwOBRe6Loz+h6IedCzg/r0/inTPnR9XWKC/g2HpuZ9SyjRQ2J4QlDLD1WA==',key_name='tempest-keypair-641815070',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:12:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a82aa8e6724a41e1a4e4d7783876536e',ramdisk_id='',reservation_id='r-s06nam6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-581564101',owner_user_name='tempest-AttachVolumeTestJSON-581564101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e4e432ab0d448db8c2437e40cbe0cd',uuid=84bf295a-37fa-4463-bddb-38ac2c5d2cf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converting VIF {"id": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "address": "fa:16:3e:23:7a:d0", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b573e5-ec", "ovs_interfaceid": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG os_vif [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4b573e5-ec, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:21:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:21:57 user nova-compute[72019]: INFO os_vif [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:7a:d0,bridge_name='br-int',has_traffic_filtering=True,id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b573e5-ec')
Apr 14 13:21:57 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Deleting instance files /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7_del
Apr 14 13:21:57 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Deletion of /opt/stack/data/nova/instances/84bf295a-37fa-4463-bddb-38ac2c5d2cf7_del complete
Apr 14 13:21:58 user nova-compute[72019]: INFO nova.compute.manager [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 14 13:21:58 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:21:58 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:21:58 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:21:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:58 user nova-compute[72019]: INFO nova.compute.manager [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Detaching volume e5cb1d40-77ed-4de5-b20c-c574e4ef2507
Apr 14 13:21:58 user nova-compute[72019]: INFO nova.virt.block_device [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Attempting to driver detach volume e5cb1d40-77ed-4de5-b20c-c574e4ef2507 from mountpoint /dev/vdb
Apr 14 13:21:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Attempting to detach device vdb from instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:21:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:21:58 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:21:58 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:21:58 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:21:58 user nova-compute[72019]:   <serial>e5cb1d40-77ed-4de5-b20c-c574e4ef2507</serial>
Apr 14 13:21:58 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:21:58 user nova-compute[72019]: </disk>
Apr 14 13:21:58 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:21:58 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Successfully detached device vdb from instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e from the persistent domain config.
Apr 14 13:21:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:21:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:21:58 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:21:58 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:21:58 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:21:58 user nova-compute[72019]:   <serial>e5cb1d40-77ed-4de5-b20c-c574e4ef2507</serial>
Apr 14 13:21:58 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:21:58 user nova-compute[72019]: </disk>
Apr 14 13:21:58 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:21:58 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:21:58 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Took 0.90 seconds to deallocate network for instance.
Apr 14 13:21:58 user nova-compute[72019]: DEBUG nova.compute.manager [req-4de24fda-c749-4145-a90a-9e593a4d3739 req-62f9ba36-841c-4f53-8783-959f8d7883fa service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-vif-deleted-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:58 user nova-compute[72019]: INFO nova.compute.manager [req-4de24fda-c749-4145-a90a-9e593a4d3739 req-62f9ba36-841c-4f53-8783-959f8d7883fa service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Neutron deleted interface e4b573e5-ec9a-4d14-974b-d8f2bf49c980; detaching it from the instance and deleting it from the info cache
Apr 14 13:21:58 user nova-compute[72019]: DEBUG nova.network.neutron [req-4de24fda-c749-4145-a90a-9e593a4d3739 req-62f9ba36-841c-4f53-8783-959f8d7883fa service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:21:58 user nova-compute[72019]: DEBUG nova.compute.manager [req-4de24fda-c749-4145-a90a-9e593a4d3739 req-62f9ba36-841c-4f53-8783-959f8d7883fa service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Detach interface failed, port_id=e4b573e5-ec9a-4d14-974b-d8f2bf49c980, reason: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:21:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478519.137631, 65e98ad1-3573-4dce-b9de-bbb1c36ed02e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:21:59 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Successfully detached device vdb from instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e from the live domain config.
Apr 14 13:21:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxdeiubO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:21:59 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9da61ef-63b9-4270-8e24-5dd9ed9afa0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:21:59 user nova-compute[72019]: No targets found.
Apr 14 13:21:59 user nova-compute[72019]: iSNS:
Apr 14 13:21:59 user nova-compute[72019]: No targets found.
Apr 14 13:21:59 user nova-compute[72019]: STATIC:
Apr 14 13:21:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:21:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507
Apr 14 13:21:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e
Apr 14 13:21:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80
Apr 14 13:21:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839
Apr 14 13:21:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:21:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:21:59 user nova-compute[72019]: FIRMWARE:
Apr 14 13:21:59 user nova-compute[72019]: No targets found.
Apr 14 13:21:59 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:21:59 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:21:59 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a54cee3-022d-4e78-b31a-4056dbf8c55f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f268529-fda3-4b15-bfb1-fb558d0ea1cd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:59 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:59 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:59 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:21:59 user nova-compute[72019]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)
Apr 14 13:21:59 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 (non-flash)
Apr 14 13:21:59 user nova-compute[72019]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:21:59 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:21:59 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:21:59 user nova-compute[72019]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)
Apr 14 13:21:59 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f749cb58700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507'): ({'sdb'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Removing single pathed devices sdb {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2c4b58-93a3-449c-a6f6-d79bdf41334f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c750cf-1530-489f-be1e-55fcd5134098]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Flushing IO for device /dev/sdb {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.148s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf4de6b-6cbb-4f4a-81d8-0cb97cd0310d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-a9683dd0-c2b9-4ffd-8d2e-147c61ef76e7 req-a9027548-b233-464d-abc9-66fffb445a7a service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a9683dd0-c2b9-4ffd-8d2e-147c61ef76e7 req-a9027548-b233-464d-abc9-66fffb445a7a service nova] Acquiring lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a9683dd0-c2b9-4ffd-8d2e-147c61ef76e7 req-a9027548-b233-464d-abc9-66fffb445a7a service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a9683dd0-c2b9-4ffd-8d2e-147c61ef76e7 req-a9027548-b233-464d-abc9-66fffb445a7a service nova] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-a9683dd0-c2b9-4ffd-8d2e-147c61ef76e7 req-a9027548-b233-464d-abc9-66fffb445a7a service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] No waiting events found dispatching network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:21:59 user nova-compute[72019]: WARNING nova.compute.manager [req-a9683dd0-c2b9-4ffd-8d2e-147c61ef76e7 req-a9027548-b233-464d-abc9-66fffb445a7a service nova] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Received unexpected event network-vif-plugged-e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance with vm_state deleted and task_state None.
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[399aeb37-d004-41fc-a6d6-8e7a8f56c010]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.577s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bf98b9-3287-4615-a1e9-57aee04bc9b2]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:59 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Deleted allocations for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3ea2fa-74b9-4deb-877b-54ad112e7b2c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507, portal: 172.16.0.220,3260]
Apr 14 13:21:59 user nova-compute[72019]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507, portal: 172.16.0.220,3260] successful.
Apr 14 13:21:59 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cb1d40-77ed-4de5-b20c-c574e4ef2507 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[771c01da-717e-4794-af9c-6fc715ce22fc]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.550s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] <== disconnect_volume: return (553ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:21:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "84bf295a-37fa-4463-bddb-38ac2c5d2cf7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.745s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:00 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'flavor' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:22:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.364s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:10 user nova-compute[72019]: INFO nova.compute.manager [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Terminating instance
Apr 14 13:22:10 user nova-compute[72019]: DEBUG nova.compute.manager [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-f91f7496-72d8-4d81-a411-886ba59ebc9b req-4406d593-cd23-4dc3-9dd7-84b749fb90b0 service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Received event network-vif-unplugged-e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f91f7496-72d8-4d81-a411-886ba59ebc9b req-4406d593-cd23-4dc3-9dd7-84b749fb90b0 service nova] Acquiring lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f91f7496-72d8-4d81-a411-886ba59ebc9b req-4406d593-cd23-4dc3-9dd7-84b749fb90b0 service nova] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f91f7496-72d8-4d81-a411-886ba59ebc9b req-4406d593-cd23-4dc3-9dd7-84b749fb90b0 service nova] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-f91f7496-72d8-4d81-a411-886ba59ebc9b req-4406d593-cd23-4dc3-9dd7-84b749fb90b0 service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] No waiting events found dispatching network-vif-unplugged-e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-f91f7496-72d8-4d81-a411-886ba59ebc9b req-4406d593-cd23-4dc3-9dd7-84b749fb90b0 service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Received event network-vif-unplugged-e4d4e52c-5363-4345-9db1-022e8287c65a for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:10 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Instance destroyed successfully.
Apr 14 13:22:10 user nova-compute[72019]: DEBUG nova.objects.instance [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'resources' on Instance uuid dca3424c-cbca-4520-a495-8867c2a9c0c4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:19:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1960301141',display_name='tempest-AttachVolumeNegativeTest-server-1960301141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1960301141',id=26,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH4IGWPc2G0woSBSu59i2dIWuZuV2nLiEWGcOxBrVeMBfugBK5jZvg3HQO8pKqc4IgnzE7IGw/8/i8zne6vY1fFpHLFViOafQnKXwfPPryecMrr8w+IVET1IuOjpJRNTA==',key_name='tempest-keypair-858857094',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:19:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6833a69217034c4d85ff10bf8aa2fa5c',ramdisk_id='',reservation_id='r-amlcx4kr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-893959880',owner_user_name='tempest-AttachVolumeNegativeTest-893959880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:19:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65812c6559684eddbdde33cd64ca1fba',uuid=dca3424c-cbca-4520-a495-8867c2a9c0c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4d4e52c-5363-4345-9db1-022e8287c65a", "address": "fa:16:3e:dd:8e:8b", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d4e52c-53", "ovs_interfaceid": "e4d4e52c-5363-4345-9db1-022e8287c65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converting VIF {"id": "e4d4e52c-5363-4345-9db1-022e8287c65a", "address": "fa:16:3e:dd:8e:8b", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d4e52c-53", "ovs_interfaceid": "e4d4e52c-5363-4345-9db1-022e8287c65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:8e:8b,bridge_name='br-int',has_traffic_filtering=True,id=e4d4e52c-5363-4345-9db1-022e8287c65a,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d4e52c-53') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG os_vif [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:8e:8b,bridge_name='br-int',has_traffic_filtering=True,id=e4d4e52c-5363-4345-9db1-022e8287c65a,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d4e52c-53') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4d4e52c-53, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:10 user nova-compute[72019]: INFO os_vif [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:8e:8b,bridge_name='br-int',has_traffic_filtering=True,id=e4d4e52c-5363-4345-9db1-022e8287c65a,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d4e52c-53')
Apr 14 13:22:10 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Deleting instance files /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4_del
Apr 14 13:22:10 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Deletion of /opt/stack/data/nova/instances/dca3424c-cbca-4520-a495-8867c2a9c0c4_del complete
Apr 14 13:22:10 user nova-compute[72019]: INFO nova.compute.manager [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 14 13:22:10 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:22:10 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:22:11 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:22:11 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Took 0.78 seconds to deallocate network for instance.
Apr 14 13:22:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:12 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:22:12 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:22:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:12 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Deleted allocations for instance dca3424c-cbca-4520-a495-8867c2a9c0c4
Apr 14 13:22:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.251s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-b062ce6f-f170-4b9a-bb32-7f608e2b6d29 req-331d1fd0-00e0-40cd-a28a-a56e06c00028 service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Received event network-vif-plugged-e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:22:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b062ce6f-f170-4b9a-bb32-7f608e2b6d29 req-331d1fd0-00e0-40cd-a28a-a56e06c00028 service nova] Acquiring lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b062ce6f-f170-4b9a-bb32-7f608e2b6d29 req-331d1fd0-00e0-40cd-a28a-a56e06c00028 service nova] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b062ce6f-f170-4b9a-bb32-7f608e2b6d29 req-331d1fd0-00e0-40cd-a28a-a56e06c00028 service nova] Lock "dca3424c-cbca-4520-a495-8867c2a9c0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-b062ce6f-f170-4b9a-bb32-7f608e2b6d29 req-331d1fd0-00e0-40cd-a28a-a56e06c00028 service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] No waiting events found dispatching network-vif-plugged-e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:22:12 user nova-compute[72019]: WARNING nova.compute.manager [req-b062ce6f-f170-4b9a-bb32-7f608e2b6d29 req-331d1fd0-00e0-40cd-a28a-a56e06c00028 service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Received unexpected event network-vif-plugged-e4d4e52c-5363-4345-9db1-022e8287c65a for instance with vm_state deleted and task_state None.
Apr 14 13:22:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-b062ce6f-f170-4b9a-bb32-7f608e2b6d29 req-331d1fd0-00e0-40cd-a28a-a56e06c00028 service nova] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Received event network-vif-deleted-e4d4e52c-5363-4345-9db1-022e8287c65a {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:22:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:12 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478517.806875, 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:22:12 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] VM Stopped (Lifecycle Event)
Apr 14 13:22:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-66f95ebb-b393-4191-a387-8a859af08a19 None None] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:22:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "49467859-954f-498d-b520-587c7f38effc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "49467859-954f-498d-b520-587c7f38effc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:22:19 user nova-compute[72019]: INFO nova.compute.claims [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Claim successful on node user
Apr 14 13:22:19 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG nova.network.neutron [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:22:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:22:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG nova.policy [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:22:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Creating image(s)
Apr 14 13:22:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "/opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "/opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "/opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "32352c08c2d4f8c1c8764357c91f019a97457fcf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "32352c08c2d4f8c1c8764357c91f019a97457fcf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf.part --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf.part --force-share --output=json" returned: 0 in 0.186s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:20 user nova-compute[72019]: DEBUG nova.virt.images [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] e02d2ab7-d36b-42ce-8a09-589fe97d2745 was qcow2, converting to raw {{(pid=72019) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 13:22:20 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:22:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf.part /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf.converted {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:20 user nova-compute[72019]: DEBUG nova.network.neutron [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Successfully created port: bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:22:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf.part /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf.converted" returned: 0 in 0.208s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf.converted --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "32352c08c2d4f8c1c8764357c91f019a97457fcf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.969s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf --force-share --output=json" returned: 0 in 0.144s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "32352c08c2d4f8c1c8764357c91f019a97457fcf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "32352c08c2d4f8c1c8764357c91f019a97457fcf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf,backing_fmt=raw /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf,backing_fmt=raw /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk 1073741824" returned: 0 in 0.058s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "32352c08c2d4f8c1c8764357c91f019a97457fcf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG nova.network.neutron [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Successfully updated port: bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquired lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG nova.network.neutron [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-661a42e9-3743-4707-a710-2ab23ec53e58 req-8ff8aa95-e806-49df-96ee-e04cb34718ae service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-changed-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-661a42e9-3743-4707-a710-2ab23ec53e58 req-8ff8aa95-e806-49df-96ee-e04cb34718ae service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Refreshing instance network info cache due to event network-changed-bcff28e3-32d8-4f26-b087-4b1082f06cfb. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-661a42e9-3743-4707-a710-2ab23ec53e58 req-8ff8aa95-e806-49df-96ee-e04cb34718ae service nova] Acquiring lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG nova.network.neutron [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Cannot resize image /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG nova.objects.instance [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'migration_context' on Instance uuid 49467859-954f-498d-b520-587c7f38effc {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Ensure instance console log exists: /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.network.neutron [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Updating instance_info_cache with network_info: [{"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Releasing lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Instance network_info: |[{"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-661a42e9-3743-4707-a710-2ab23ec53e58 req-8ff8aa95-e806-49df-96ee-e04cb34718ae service nova] Acquired lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.network.neutron [req-661a42e9-3743-4707-a710-2ab23ec53e58 req-8ff8aa95-e806-49df-96ee-e04cb34718ae service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Refreshing network info cache for port bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Start _get_guest_xml network_info=[{"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:22:16Z,direct_url=<?>,disk_format='qcow2',id=e02d2ab7-d36b-42ce-8a09-589fe97d2745,min_disk=0,min_ram=0,name='tempest-scenario-img--377693384',owner='9ae2e95243bc4e19b093629197fbb173',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:22:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': 'e02d2ab7-d36b-42ce-8a09-589fe97d2745'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:22:22 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:22:22 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:22:16Z,direct_url=<?>,disk_format='qcow2',id=e02d2ab7-d36b-42ce-8a09-589fe97d2745,min_disk=0,min_ram=0,name='tempest-scenario-img--377693384',owner='9ae2e95243bc4e19b093629197fbb173',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:22:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-672930101',display_name='tempest-TestMinimumBasicScenario-server-672930101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-672930101',id=30,image_ref='e02d2ab7-d36b-42ce-8a09-589fe97d2745',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyN7ZXz/DhnftGXoG1DqPcVc2gONInGkCMU1F9WltEW9B7MyWX6QLuMCCaRSexfOtRkN3kvfw4EU0QaJ4W82L+01s5mIUUjLtEeLBACLFDo9jDFd26Q2mqx8aDpkmAeHQ==',key_name='tempest-TestMinimumBasicScenario-1723696496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae2e95243bc4e19b093629197fbb173',ramdisk_id='',reservation_id='r-nhxs7xka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e02d2ab7-d36b-42ce-8a09-589fe97d2745',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-929002235',owner_user_name='tempest-TestMinimumBasicScenario-929002235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:22:20Z,user_data=None,user_id='9e1f366e5f9d43b9bbd8be316ddaa3a9',uuid=49467859-954f-498d-b520-587c7f38effc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converting VIF {"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:60:67,bridge_name='br-int',has_traffic_filtering=True,id=bcff28e3-32d8-4f26-b087-4b1082f06cfb,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcff28e3-32') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.objects.instance [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'pci_devices' on Instance uuid 49467859-954f-498d-b520-587c7f38effc {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:22:22 user nova-compute[72019]:   <uuid>49467859-954f-498d-b520-587c7f38effc</uuid>
Apr 14 13:22:22 user nova-compute[72019]:   <name>instance-0000001e</name>
Apr 14 13:22:22 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:22:22 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:22:22 user nova-compute[72019]:   <metadata>
Apr 14 13:22:22 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:22:22 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:22:22 user nova-compute[72019]:       <nova:name>tempest-TestMinimumBasicScenario-server-672930101</nova:name>
Apr 14 13:22:22 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:22:22</nova:creationTime>
Apr 14 13:22:22 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:22:22 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:22:22 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:22:22 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:22:22 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:22:22 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:22:22 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:22:22 user nova-compute[72019]:       <nova:owner>
Apr 14 13:22:22 user nova-compute[72019]:         <nova:user uuid="9e1f366e5f9d43b9bbd8be316ddaa3a9">tempest-TestMinimumBasicScenario-929002235-project-member</nova:user>
Apr 14 13:22:22 user nova-compute[72019]:         <nova:project uuid="9ae2e95243bc4e19b093629197fbb173">tempest-TestMinimumBasicScenario-929002235</nova:project>
Apr 14 13:22:22 user nova-compute[72019]:       </nova:owner>
Apr 14 13:22:22 user nova-compute[72019]:       <nova:root type="image" uuid="e02d2ab7-d36b-42ce-8a09-589fe97d2745"/>
Apr 14 13:22:22 user nova-compute[72019]:       <nova:ports>
Apr 14 13:22:22 user nova-compute[72019]:         <nova:port uuid="bcff28e3-32d8-4f26-b087-4b1082f06cfb">
Apr 14 13:22:22 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 13:22:22 user nova-compute[72019]:         </nova:port>
Apr 14 13:22:22 user nova-compute[72019]:       </nova:ports>
Apr 14 13:22:22 user nova-compute[72019]:     </nova:instance>
Apr 14 13:22:22 user nova-compute[72019]:   </metadata>
Apr 14 13:22:22 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:22:22 user nova-compute[72019]:     <system>
Apr 14 13:22:22 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:22:22 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:22:22 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:22:22 user nova-compute[72019]:       <entry name="serial">49467859-954f-498d-b520-587c7f38effc</entry>
Apr 14 13:22:22 user nova-compute[72019]:       <entry name="uuid">49467859-954f-498d-b520-587c7f38effc</entry>
Apr 14 13:22:22 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:22:22 user nova-compute[72019]:     </system>
Apr 14 13:22:22 user nova-compute[72019]:   </sysinfo>
Apr 14 13:22:22 user nova-compute[72019]:   <os>
Apr 14 13:22:22 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:22:22 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:22:22 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:22:22 user nova-compute[72019]:   </os>
Apr 14 13:22:22 user nova-compute[72019]:   <features>
Apr 14 13:22:22 user nova-compute[72019]:     <acpi/>
Apr 14 13:22:22 user nova-compute[72019]:     <apic/>
Apr 14 13:22:22 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:22:22 user nova-compute[72019]:   </features>
Apr 14 13:22:22 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:22:22 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:22:22 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:22:22 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:22:22 user nova-compute[72019]:   </clock>
Apr 14 13:22:22 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:22:22 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:22:22 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:22:22 user nova-compute[72019]:   </cpu>
Apr 14 13:22:22 user nova-compute[72019]:   <devices>
Apr 14 13:22:22 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:22:22 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:22:22 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk"/>
Apr 14 13:22:22 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:22:22 user nova-compute[72019]:     </disk>
Apr 14 13:22:22 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:22:22 user nova-compute[72019]:       <mac address="fa:16:3e:20:60:67"/>
Apr 14 13:22:22 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:22:22 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:22:22 user nova-compute[72019]:       <target dev="tapbcff28e3-32"/>
Apr 14 13:22:22 user nova-compute[72019]:     </interface>
Apr 14 13:22:22 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:22:22 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/console.log" append="off"/>
Apr 14 13:22:22 user nova-compute[72019]:     </serial>
Apr 14 13:22:22 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:22:22 user nova-compute[72019]:     <video>
Apr 14 13:22:22 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:22:22 user nova-compute[72019]:     </video>
Apr 14 13:22:22 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:22:22 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:22:22 user nova-compute[72019]:     </rng>
Apr 14 13:22:22 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:22:22 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:22:22 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:22:22 user nova-compute[72019]:     </memballoon>
Apr 14 13:22:22 user nova-compute[72019]:   </devices>
Apr 14 13:22:22 user nova-compute[72019]: </domain>
Apr 14 13:22:22 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-672930101',display_name='tempest-TestMinimumBasicScenario-server-672930101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-672930101',id=30,image_ref='e02d2ab7-d36b-42ce-8a09-589fe97d2745',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyN7ZXz/DhnftGXoG1DqPcVc2gONInGkCMU1F9WltEW9B7MyWX6QLuMCCaRSexfOtRkN3kvfw4EU0QaJ4W82L+01s5mIUUjLtEeLBACLFDo9jDFd26Q2mqx8aDpkmAeHQ==',key_name='tempest-TestMinimumBasicScenario-1723696496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae2e95243bc4e19b093629197fbb173',ramdisk_id='',reservation_id='r-nhxs7xka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e02d2ab7-d36b-42ce-8a09-589fe97d2745',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-929002235',owner_user_name='tempest-TestMinimumBasicScenario-929002235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:22:20Z,user_data=None,user_id='9e1f366e5f9d43b9bbd8be316ddaa3a9',uuid=49467859-954f-498d-b520-587c7f38effc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converting VIF {"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:60:67,bridge_name='br-int',has_traffic_filtering=True,id=bcff28e3-32d8-4f26-b087-4b1082f06cfb,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcff28e3-32') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG os_vif [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:60:67,bridge_name='br-int',has_traffic_filtering=True,id=bcff28e3-32d8-4f26-b087-4b1082f06cfb,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcff28e3-32') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcff28e3-32, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbcff28e3-32, col_values=(('external_ids', {'iface-id': 'bcff28e3-32d8-4f26-b087-4b1082f06cfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:60:67', 'vm-uuid': '49467859-954f-498d-b520-587c7f38effc'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:22 user nova-compute[72019]: INFO os_vif [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:60:67,bridge_name='br-int',has_traffic_filtering=True,id=bcff28e3-32d8-4f26-b087-4b1082f06cfb,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcff28e3-32')
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] No VIF found with MAC fa:16:3e:20:60:67, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.network.neutron [req-661a42e9-3743-4707-a710-2ab23ec53e58 req-8ff8aa95-e806-49df-96ee-e04cb34718ae service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Updated VIF entry in instance network info cache for port bcff28e3-32d8-4f26-b087-4b1082f06cfb. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG nova.network.neutron [req-661a42e9-3743-4707-a710-2ab23ec53e58 req-8ff8aa95-e806-49df-96ee-e04cb34718ae service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Updating instance_info_cache with network_info: [{"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:22:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-661a42e9-3743-4707-a710-2ab23ec53e58 req-8ff8aa95-e806-49df-96ee-e04cb34718ae service nova] Releasing lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:22:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-94d93b71-a721-4d68-b4da-51a9e33786e4 req-3f123a6a-36fc-4d5e-ba88-88396ea60ddb service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:22:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-94d93b71-a721-4d68-b4da-51a9e33786e4 req-3f123a6a-36fc-4d5e-ba88-88396ea60ddb service nova] Acquiring lock "49467859-954f-498d-b520-587c7f38effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-94d93b71-a721-4d68-b4da-51a9e33786e4 req-3f123a6a-36fc-4d5e-ba88-88396ea60ddb service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-94d93b71-a721-4d68-b4da-51a9e33786e4 req-3f123a6a-36fc-4d5e-ba88-88396ea60ddb service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-94d93b71-a721-4d68-b4da-51a9e33786e4 req-3f123a6a-36fc-4d5e-ba88-88396ea60ddb service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] No waiting events found dispatching network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:22:23 user nova-compute[72019]: WARNING nova.compute.manager [req-94d93b71-a721-4d68-b4da-51a9e33786e4 req-3f123a6a-36fc-4d5e-ba88-88396ea60ddb service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received unexpected event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance with vm_state building and task_state spawning.
Apr 14 13:22:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478545.7463877, 49467859-954f-498d-b520-587c7f38effc => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:22:25 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] VM Resumed (Lifecycle Event)
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:22:25 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 49467859-954f-498d-b520-587c7f38effc] Instance spawned successfully.
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:22:25 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478545.7483733, 49467859-954f-498d-b520-587c7f38effc => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:22:25 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] VM Started (Lifecycle Event)
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478530.8309972, dca3424c-cbca-4520-a495-8867c2a9c0c4 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:22:25 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] VM Stopped (Lifecycle Event)
Apr 14 13:22:25 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1a1111ee-ff34-40d4-8a55-bbd6b4136527 None None] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:22:25 user nova-compute[72019]: INFO nova.compute.manager [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Took 5.99 seconds to spawn the instance on the hypervisor.
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-14abdcd5-da01-4e9f-ac51-3fe8727ba071 req-0ae6190c-bd84-42e4-8d9b-316cb70f1c4e service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-14abdcd5-da01-4e9f-ac51-3fe8727ba071 req-0ae6190c-bd84-42e4-8d9b-316cb70f1c4e service nova] Acquiring lock "49467859-954f-498d-b520-587c7f38effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-14abdcd5-da01-4e9f-ac51-3fe8727ba071 req-0ae6190c-bd84-42e4-8d9b-316cb70f1c4e service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-14abdcd5-da01-4e9f-ac51-3fe8727ba071 req-0ae6190c-bd84-42e4-8d9b-316cb70f1c4e service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-14abdcd5-da01-4e9f-ac51-3fe8727ba071 req-0ae6190c-bd84-42e4-8d9b-316cb70f1c4e service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] No waiting events found dispatching network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:22:25 user nova-compute[72019]: WARNING nova.compute.manager [req-14abdcd5-da01-4e9f-ac51-3fe8727ba071 req-0ae6190c-bd84-42e4-8d9b-316cb70f1c4e service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received unexpected event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance with vm_state building and task_state spawning.
Apr 14 13:22:25 user nova-compute[72019]: INFO nova.compute.manager [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Took 6.73 seconds to build instance.
Apr 14 13:22:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "49467859-954f-498d-b520-587c7f38effc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.825s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Updating instance_info_cache with network_info: [{"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:22:30 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:22:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:34 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:22:34 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:22:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7517MB free_disk=26.093807220458984GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 775293fc-1773-407d-bf49-fccfe849f440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 49467859-954f-498d-b520-587c7f38effc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:22:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:22:35 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:22:35 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:22:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:22:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.760s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:22:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:51 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:22:51 user nova-compute[72019]: INFO nova.compute.claims [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Claim successful on node user
Apr 14 13:22:51 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:22:51 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:22:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:22:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:22:51 user nova-compute[72019]: DEBUG nova.network.neutron [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:22:51 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:22:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:22:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:22:52 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Creating image(s)
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "/opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "/opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG nova.policy [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.173s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.148s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:52 user nova-compute[72019]: INFO nova.compute.manager [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Terminating instance
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG nova.compute.manager [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk 1073741824" returned: 0 in 0.059s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.187s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Cannot resize image /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG nova.objects.instance [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'migration_context' on Instance uuid ed09e4b4-dd5f-4200-be08-7260da0c7d85 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG nova.compute.manager [req-c7345c82-1a38-405c-9798-83af8fbef9c0 req-e2188568-ffb9-4a2a-8b11-1a03c4820755 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-vif-unplugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c7345c82-1a38-405c-9798-83af8fbef9c0 req-e2188568-ffb9-4a2a-8b11-1a03c4820755 service nova] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c7345c82-1a38-405c-9798-83af8fbef9c0 req-e2188568-ffb9-4a2a-8b11-1a03c4820755 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c7345c82-1a38-405c-9798-83af8fbef9c0 req-e2188568-ffb9-4a2a-8b11-1a03c4820755 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG nova.compute.manager [req-c7345c82-1a38-405c-9798-83af8fbef9c0 req-e2188568-ffb9-4a2a-8b11-1a03c4820755 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] No waiting events found dispatching network-vif-unplugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG nova.compute.manager [req-c7345c82-1a38-405c-9798-83af8fbef9c0 req-e2188568-ffb9-4a2a-8b11-1a03c4820755 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-vif-unplugged-965f15ad-1141-41f1-b9f3-41097bb21b5e for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Ensure instance console log exists: /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:53 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Instance destroyed successfully.
Apr 14 13:22:53 user nova-compute[72019]: DEBUG nova.objects.instance [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'resources' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:22:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-450055877',display_name='tempest-ServerStableDeviceRescueTest-server-450055877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-450055877',id=15,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjseCXo591Ib7m2QQg2YUiEmBpT41KO6pBZujMk3kb1ezcLxBJnhodHUloea6z3H0OhTIU/PPnS5Viw3M1jYSulnA0hMkrnmWEGu58Pu2ctSWI3CS0ih18sa0sVBubY/Q==',key_name='tempest-keypair-1253237269',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:19:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76b733f664b340e289c562e19ebd28c3',ramdisk_id='',reservation_id='r-t3f59y77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-583958040',owner_user_name='tempest-ServerStableDeviceRescueTest-583958040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='065f23d461f44751a6911adcd3124fe9',uuid=65e98ad1-3573-4dce-b9de-bbb1c36ed02e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:22:53 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Converting VIF {"id": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "address": "fa:16:3e:79:ac:fd", "network": {"id": "1791e209-7b0c-4262-a342-ed1523633f77", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2036620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76b733f664b340e289c562e19ebd28c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965f15ad-11", "ovs_interfaceid": "965f15ad-1141-41f1-b9f3-41097bb21b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:22:53 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=965f15ad-1141-41f1-b9f3-41097bb21b5e,network=Network(1791e209-7b0c-4262-a342-ed1523633f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965f15ad-11') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:22:53 user nova-compute[72019]: DEBUG os_vif [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=965f15ad-1141-41f1-b9f3-41097bb21b5e,network=Network(1791e209-7b0c-4262-a342-ed1523633f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965f15ad-11') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:22:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap965f15ad-11, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:22:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:22:53 user nova-compute[72019]: INFO os_vif [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:ac:fd,bridge_name='br-int',has_traffic_filtering=True,id=965f15ad-1141-41f1-b9f3-41097bb21b5e,network=Network(1791e209-7b0c-4262-a342-ed1523633f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965f15ad-11')
Apr 14 13:22:53 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Deleting instance files /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e_del
Apr 14 13:22:53 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Deletion of /opt/stack/data/nova/instances/65e98ad1-3573-4dce-b9de-bbb1c36ed02e_del complete
Apr 14 13:22:53 user nova-compute[72019]: INFO nova.compute.manager [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 14 13:22:53 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:22:53 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:22:53 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:22:53 user nova-compute[72019]: DEBUG nova.network.neutron [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Successfully created port: 0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:22:54 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:22:54 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Took 1.20 seconds to deallocate network for instance.
Apr 14 13:22:54 user nova-compute[72019]: DEBUG nova.network.neutron [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Successfully updated port: 0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:22:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "refresh_cache-ed09e4b4-dd5f-4200-be08-7260da0c7d85" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:22:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquired lock "refresh_cache-ed09e4b4-dd5f-4200-be08-7260da0c7d85" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:22:54 user nova-compute[72019]: DEBUG nova.network.neutron [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:22:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-1e566310-9091-4ae4-ab7e-8ac35a43b265 req-4e822c66-9975-4eee-9f96-ecb967b48965 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-vif-deleted-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:22:54 user nova-compute[72019]: DEBUG nova.network.neutron [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:22:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-d77a1252-38e0-4e47-9ed8-9b84fdcfc364 req-a8a4c6a7-e886-4793-9478-c8cfde56edd0 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:22:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d77a1252-38e0-4e47-9ed8-9b84fdcfc364 req-a8a4c6a7-e886-4793-9478-c8cfde56edd0 service nova] Acquiring lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d77a1252-38e0-4e47-9ed8-9b84fdcfc364 req-a8a4c6a7-e886-4793-9478-c8cfde56edd0 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d77a1252-38e0-4e47-9ed8-9b84fdcfc364 req-a8a4c6a7-e886-4793-9478-c8cfde56edd0 service nova] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-d77a1252-38e0-4e47-9ed8-9b84fdcfc364 req-a8a4c6a7-e886-4793-9478-c8cfde56edd0 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] No waiting events found dispatching network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:22:54 user nova-compute[72019]: WARNING nova.compute.manager [req-d77a1252-38e0-4e47-9ed8-9b84fdcfc364 req-a8a4c6a7-e886-4793-9478-c8cfde56edd0 service nova] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Received unexpected event network-vif-plugged-965f15ad-1141-41f1-b9f3-41097bb21b5e for instance with vm_state deleted and task_state None.
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.network.neutron [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Updating instance_info_cache with network_info: [{"id": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "address": "fa:16:3e:66:c1:bf", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a44c0e9-c7", "ovs_interfaceid": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Releasing lock "refresh_cache-ed09e4b4-dd5f-4200-be08-7260da0c7d85" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Instance network_info: |[{"id": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "address": "fa:16:3e:66:c1:bf", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a44c0e9-c7", "ovs_interfaceid": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Start _get_guest_xml network_info=[{"id": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "address": "fa:16:3e:66:c1:bf", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a44c0e9-c7", "ovs_interfaceid": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:55 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:22:55 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1437128410',display_name='tempest-AttachVolumeTestJSON-server-1437128410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1437128410',id=31,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKA26k0WYP8XCfCvBrpz4NFr3gf94+RBw4IFB1YpeSMcv8eoVWhtwKyWANDeja3cxf2gVPhnwh2tbJr3VvhOmIT9iaH6e76r9kQFye1uFeSzTKshoLyYKFXls3FDPOClA==',key_name='tempest-keypair-531734162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a82aa8e6724a41e1a4e4d7783876536e',ramdisk_id='',reservation_id='r-z4n913zw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-581564101',owner_user_name='tempest-AttachVolumeTestJSON-581564101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:22:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e4e432ab0d448db8c2437e40cbe0cd',uuid=ed09e4b4-dd5f-4200-be08-7260da0c7d85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "address": "fa:16:3e:66:c1:bf", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a44c0e9-c7", "ovs_interfaceid": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converting VIF {"id": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "address": "fa:16:3e:66:c1:bf", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a44c0e9-c7", "ovs_interfaceid": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:c1:bf,bridge_name='br-int',has_traffic_filtering=True,id=0a44c0e9-c717-4924-b996-4f0db4d1c1a3,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a44c0e9-c7') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.objects.instance [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'pci_devices' on Instance uuid ed09e4b4-dd5f-4200-be08-7260da0c7d85 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:22:55 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Deleted allocations for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:22:55 user nova-compute[72019]:   <uuid>ed09e4b4-dd5f-4200-be08-7260da0c7d85</uuid>
Apr 14 13:22:55 user nova-compute[72019]:   <name>instance-0000001f</name>
Apr 14 13:22:55 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:22:55 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:22:55 user nova-compute[72019]:   <metadata>
Apr 14 13:22:55 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:22:55 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:22:55 user nova-compute[72019]:       <nova:name>tempest-AttachVolumeTestJSON-server-1437128410</nova:name>
Apr 14 13:22:55 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:22:55</nova:creationTime>
Apr 14 13:22:55 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:22:55 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:22:55 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:22:55 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:22:55 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:22:55 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:22:55 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:22:55 user nova-compute[72019]:       <nova:owner>
Apr 14 13:22:55 user nova-compute[72019]:         <nova:user uuid="d7e4e432ab0d448db8c2437e40cbe0cd">tempest-AttachVolumeTestJSON-581564101-project-member</nova:user>
Apr 14 13:22:55 user nova-compute[72019]:         <nova:project uuid="a82aa8e6724a41e1a4e4d7783876536e">tempest-AttachVolumeTestJSON-581564101</nova:project>
Apr 14 13:22:55 user nova-compute[72019]:       </nova:owner>
Apr 14 13:22:55 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:22:55 user nova-compute[72019]:       <nova:ports>
Apr 14 13:22:55 user nova-compute[72019]:         <nova:port uuid="0a44c0e9-c717-4924-b996-4f0db4d1c1a3">
Apr 14 13:22:55 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 13:22:55 user nova-compute[72019]:         </nova:port>
Apr 14 13:22:55 user nova-compute[72019]:       </nova:ports>
Apr 14 13:22:55 user nova-compute[72019]:     </nova:instance>
Apr 14 13:22:55 user nova-compute[72019]:   </metadata>
Apr 14 13:22:55 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:22:55 user nova-compute[72019]:     <system>
Apr 14 13:22:55 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:22:55 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:22:55 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:22:55 user nova-compute[72019]:       <entry name="serial">ed09e4b4-dd5f-4200-be08-7260da0c7d85</entry>
Apr 14 13:22:55 user nova-compute[72019]:       <entry name="uuid">ed09e4b4-dd5f-4200-be08-7260da0c7d85</entry>
Apr 14 13:22:55 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:22:55 user nova-compute[72019]:     </system>
Apr 14 13:22:55 user nova-compute[72019]:   </sysinfo>
Apr 14 13:22:55 user nova-compute[72019]:   <os>
Apr 14 13:22:55 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:22:55 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:22:55 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:22:55 user nova-compute[72019]:   </os>
Apr 14 13:22:55 user nova-compute[72019]:   <features>
Apr 14 13:22:55 user nova-compute[72019]:     <acpi/>
Apr 14 13:22:55 user nova-compute[72019]:     <apic/>
Apr 14 13:22:55 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:22:55 user nova-compute[72019]:   </features>
Apr 14 13:22:55 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:22:55 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:22:55 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:22:55 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:22:55 user nova-compute[72019]:   </clock>
Apr 14 13:22:55 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:22:55 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:22:55 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:22:55 user nova-compute[72019]:   </cpu>
Apr 14 13:22:55 user nova-compute[72019]:   <devices>
Apr 14 13:22:55 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:22:55 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:22:55 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk"/>
Apr 14 13:22:55 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:22:55 user nova-compute[72019]:     </disk>
Apr 14 13:22:55 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:22:55 user nova-compute[72019]:       <mac address="fa:16:3e:66:c1:bf"/>
Apr 14 13:22:55 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:22:55 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:22:55 user nova-compute[72019]:       <target dev="tap0a44c0e9-c7"/>
Apr 14 13:22:55 user nova-compute[72019]:     </interface>
Apr 14 13:22:55 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:22:55 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/console.log" append="off"/>
Apr 14 13:22:55 user nova-compute[72019]:     </serial>
Apr 14 13:22:55 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:22:55 user nova-compute[72019]:     <video>
Apr 14 13:22:55 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:22:55 user nova-compute[72019]:     </video>
Apr 14 13:22:55 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:22:55 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:22:55 user nova-compute[72019]:     </rng>
Apr 14 13:22:55 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:22:55 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:22:55 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:22:55 user nova-compute[72019]:     </memballoon>
Apr 14 13:22:55 user nova-compute[72019]:   </devices>
Apr 14 13:22:55 user nova-compute[72019]: </domain>
Apr 14 13:22:55 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1437128410',display_name='tempest-AttachVolumeTestJSON-server-1437128410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1437128410',id=31,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKA26k0WYP8XCfCvBrpz4NFr3gf94+RBw4IFB1YpeSMcv8eoVWhtwKyWANDeja3cxf2gVPhnwh2tbJr3VvhOmIT9iaH6e76r9kQFye1uFeSzTKshoLyYKFXls3FDPOClA==',key_name='tempest-keypair-531734162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a82aa8e6724a41e1a4e4d7783876536e',ramdisk_id='',reservation_id='r-z4n913zw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-581564101',owner_user_name='tempest-AttachVolumeTestJSON-581564101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:22:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e4e432ab0d448db8c2437e40cbe0cd',uuid=ed09e4b4-dd5f-4200-be08-7260da0c7d85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "address": "fa:16:3e:66:c1:bf", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a44c0e9-c7", "ovs_interfaceid": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converting VIF {"id": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "address": "fa:16:3e:66:c1:bf", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a44c0e9-c7", "ovs_interfaceid": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:c1:bf,bridge_name='br-int',has_traffic_filtering=True,id=0a44c0e9-c717-4924-b996-4f0db4d1c1a3,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a44c0e9-c7') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG os_vif [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:c1:bf,bridge_name='br-int',has_traffic_filtering=True,id=0a44c0e9-c717-4924-b996-4f0db4d1c1a3,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a44c0e9-c7') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a44c0e9-c7, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a44c0e9-c7, col_values=(('external_ids', {'iface-id': '0a44c0e9-c717-4924-b996-4f0db4d1c1a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:c1:bf', 'vm-uuid': 'ed09e4b4-dd5f-4200-be08-7260da0c7d85'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:55 user nova-compute[72019]: INFO os_vif [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:c1:bf,bridge_name='br-int',has_traffic_filtering=True,id=0a44c0e9-c717-4924-b996-4f0db4d1c1a3,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a44c0e9-c7')
Apr 14 13:22:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "65e98ad1-3573-4dce-b9de-bbb1c36ed02e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.803s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:22:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] No VIF found with MAC fa:16:3e:66:c1:bf, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:22:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-43f4e41e-01bd-463e-9a31-05c68f299040 req-d681f114-97ff-441c-87e5-78d3fedf9687 service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Received event network-changed-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:22:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-43f4e41e-01bd-463e-9a31-05c68f299040 req-d681f114-97ff-441c-87e5-78d3fedf9687 service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Refreshing instance network info cache due to event network-changed-0a44c0e9-c717-4924-b996-4f0db4d1c1a3. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:22:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-43f4e41e-01bd-463e-9a31-05c68f299040 req-d681f114-97ff-441c-87e5-78d3fedf9687 service nova] Acquiring lock "refresh_cache-ed09e4b4-dd5f-4200-be08-7260da0c7d85" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:22:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-43f4e41e-01bd-463e-9a31-05c68f299040 req-d681f114-97ff-441c-87e5-78d3fedf9687 service nova] Acquired lock "refresh_cache-ed09e4b4-dd5f-4200-be08-7260da0c7d85" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:22:56 user nova-compute[72019]: DEBUG nova.network.neutron [req-43f4e41e-01bd-463e-9a31-05c68f299040 req-d681f114-97ff-441c-87e5-78d3fedf9687 service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Refreshing network info cache for port 0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-9b0a1ed1-1e6f-48f5-a2e1-cfc1628e9f8d req-362f7a01-43c1-4db4-9628-30e15e883e80 service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Received event network-vif-plugged-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9b0a1ed1-1e6f-48f5-a2e1-cfc1628e9f8d req-362f7a01-43c1-4db4-9628-30e15e883e80 service nova] Acquiring lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9b0a1ed1-1e6f-48f5-a2e1-cfc1628e9f8d req-362f7a01-43c1-4db4-9628-30e15e883e80 service nova] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9b0a1ed1-1e6f-48f5-a2e1-cfc1628e9f8d req-362f7a01-43c1-4db4-9628-30e15e883e80 service nova] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-9b0a1ed1-1e6f-48f5-a2e1-cfc1628e9f8d req-362f7a01-43c1-4db4-9628-30e15e883e80 service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] No waiting events found dispatching network-vif-plugged-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:22:57 user nova-compute[72019]: WARNING nova.compute.manager [req-9b0a1ed1-1e6f-48f5-a2e1-cfc1628e9f8d req-362f7a01-43c1-4db4-9628-30e15e883e80 service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Received unexpected event network-vif-plugged-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 for instance with vm_state building and task_state spawning.
Apr 14 13:22:57 user nova-compute[72019]: DEBUG nova.network.neutron [req-43f4e41e-01bd-463e-9a31-05c68f299040 req-d681f114-97ff-441c-87e5-78d3fedf9687 service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Updated VIF entry in instance network info cache for port 0a44c0e9-c717-4924-b996-4f0db4d1c1a3. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG nova.network.neutron [req-43f4e41e-01bd-463e-9a31-05c68f299040 req-d681f114-97ff-441c-87e5-78d3fedf9687 service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Updating instance_info_cache with network_info: [{"id": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "address": "fa:16:3e:66:c1:bf", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a44c0e9-c7", "ovs_interfaceid": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-43f4e41e-01bd-463e-9a31-05c68f299040 req-d681f114-97ff-441c-87e5-78d3fedf9687 service nova] Releasing lock "refresh_cache-ed09e4b4-dd5f-4200-be08-7260da0c7d85" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "775293fc-1773-407d-bf49-fccfe849f440" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG nova.objects.instance [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'flavor' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "775293fc-1773-407d-bf49-fccfe849f440" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "775293fc-1773-407d-bf49-fccfe849f440" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:57 user nova-compute[72019]: INFO nova.compute.manager [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Attaching volume 7f85a79b-307a-48e6-81fb-01b78bf092dc to /dev/vdb
Apr 14 13:22:58 user nova-compute[72019]: DEBUG os_brick.utils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03ab47c-5597-4b40-b70d-58a423384a7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4dc9c3-dafb-4ff7-a936-e0fac3102d3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e330c2e-b25c-46fd-a153-6bbecadd6c09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f8bf8f-661b-4cb6-b8d4-81a798bffed8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:22:58 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b75d140-f086-445d-8014-304c93c0b49c]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG os_brick.utils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Updating existing volume attachment record: 0f2f3701-0f6e-4417-a08a-0ee354f5f200 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478578.842315, ed09e4b4-dd5f-4200-be08-7260da0c7d85 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:22:58 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] VM Resumed (Lifecycle Event)
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:22:58 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Instance spawned successfully.
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.compute.manager [req-13005c1c-b0b9-4514-9efa-f3e63992eb9a req-6d7af626-a4ec-4387-ac8c-3c15fdb715f4 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-changed-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.compute.manager [req-13005c1c-b0b9-4514-9efa-f3e63992eb9a req-6d7af626-a4ec-4387-ac8c-3c15fdb715f4 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Refreshing instance network info cache due to event network-changed-aef4cd67-4e33-4456-b7d9-195955db1cdc. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-13005c1c-b0b9-4514-9efa-f3e63992eb9a req-6d7af626-a4ec-4387-ac8c-3c15fdb715f4 service nova] Acquiring lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-13005c1c-b0b9-4514-9efa-f3e63992eb9a req-6d7af626-a4ec-4387-ac8c-3c15fdb715f4 service nova] Acquired lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.network.neutron [req-13005c1c-b0b9-4514-9efa-f3e63992eb9a req-6d7af626-a4ec-4387-ac8c-3c15fdb715f4 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Refreshing network info cache for port aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:22:58 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478578.849121, ed09e4b4-dd5f-4200-be08-7260da0c7d85 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:22:58 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] VM Started (Lifecycle Event)
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:22:58 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:22:58 user nova-compute[72019]: INFO nova.compute.manager [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Took 6.85 seconds to spawn the instance on the hypervisor.
Apr 14 13:22:58 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:22:59 user nova-compute[72019]: INFO nova.compute.manager [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Took 7.86 seconds to build instance.
Apr 14 13:22:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.980s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:59 user nova-compute[72019]: DEBUG nova.network.neutron [req-13005c1c-b0b9-4514-9efa-f3e63992eb9a req-6d7af626-a4ec-4387-ac8c-3c15fdb715f4 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Updated VIF entry in instance network info cache for port aef4cd67-4e33-4456-b7d9-195955db1cdc. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:22:59 user nova-compute[72019]: DEBUG nova.network.neutron [req-13005c1c-b0b9-4514-9efa-f3e63992eb9a req-6d7af626-a4ec-4387-ac8c-3c15fdb715f4 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Updating instance_info_cache with network_info: [{"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:22:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-13005c1c-b0b9-4514-9efa-f3e63992eb9a req-6d7af626-a4ec-4387-ac8c-3c15fdb715f4 service nova] Releasing lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:22:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-dcf821bc-ad9a-40d0-be35-a74a32d6b92e req-d5c16381-7dad-4168-a5ad-a8153d477429 service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Received event network-vif-plugged-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:22:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dcf821bc-ad9a-40d0-be35-a74a32d6b92e req-d5c16381-7dad-4168-a5ad-a8153d477429 service nova] Acquiring lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:22:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dcf821bc-ad9a-40d0-be35-a74a32d6b92e req-d5c16381-7dad-4168-a5ad-a8153d477429 service nova] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:22:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dcf821bc-ad9a-40d0-be35-a74a32d6b92e req-d5c16381-7dad-4168-a5ad-a8153d477429 service nova] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:22:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-dcf821bc-ad9a-40d0-be35-a74a32d6b92e req-d5c16381-7dad-4168-a5ad-a8153d477429 service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] No waiting events found dispatching network-vif-plugged-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:22:59 user nova-compute[72019]: WARNING nova.compute.manager [req-dcf821bc-ad9a-40d0-be35-a74a32d6b92e req-d5c16381-7dad-4168-a5ad-a8153d477429 service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Received unexpected event network-vif-plugged-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 for instance with vm_state active and task_state None.
Apr 14 13:23:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUacntEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:23:03 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:23:03 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:23:03 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e14e5d-ce9b-49d0-bfb3-f3c7f3d34a77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:23:03 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ca7058-b334-4611-936a-d839369f2b84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc] added
Apr 14 13:23:03 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d662a925-7e20-4f9c-bfe4-8d825ba9fc65]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f09643-99b2-4df6-95b5-55c88a4c6773]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUacntEC {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUacntEC" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[22af507e-bdbb-462b-ae07-3c6485741378]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BUacntEC'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7485023a-b890-430c-bffe-53cf07bed77c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd724e0c-5de8-437d-913c-4abd6e4557d7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:23:03 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:23:03 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:23:03 user nova-compute[72019]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)
Apr 14 13:23:03 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:23:03 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:23:03 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:23:03 user nova-compute[72019]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)
Apr 14 13:23:03 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c31a810-5eb9-4d72-abda-a69f57975ed6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc, portal: 172.16.0.220,3260]
Apr 14 13:23:03 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc, portal: 172.16.0.220,3260] successful.
Apr 14 13:23:03 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[feff4e84-11c7-447a-b09c-75a3d3476ea3]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[721945bb-a054-42ac-9be2-dd83f496bd90]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:23:03 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:23:03 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:23:03 user nova-compute[72019]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)
Apr 14 13:23:03 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:23:03 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:23:03 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:23:03 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:23:03 user nova-compute[72019]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)
Apr 14 13:23:03 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:23:03 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d19323-b179-4413-9e47-33c6eb725e54]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:23:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUacntEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:23:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:23:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23737336261373739', 'path': '/dev/sdb'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:23:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737336261373739', 'path': '/dev/sdb'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:23:04 user nova-compute[72019]: DEBUG nova.objects.instance [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'flavor' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:23:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:23:04 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:23:04 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:23:04 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:23:04 user nova-compute[72019]:   <serial>7f85a79b-307a-48e6-81fb-01b78bf092dc</serial>
Apr 14 13:23:04 user nova-compute[72019]: </disk>
Apr 14 13:23:04 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:23:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:23:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:23:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No VIF found with MAC fa:16:3e:44:e7:34, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:23:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "01f10bee-45ba-4541-8af8-e392018ef468" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "01f10bee-45ba-4541-8af8-e392018ef468" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "775293fc-1773-407d-bf49-fccfe849f440" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.074s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:23:05 user nova-compute[72019]: INFO nova.compute.claims [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Claim successful on node user
Apr 14 13:23:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:23:05 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:23:05 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG nova.policy [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:23:05 user nova-compute[72019]: INFO nova.compute.manager [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Rescuing
Apr 14 13:23:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquired lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG nova.network.neutron [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:23:05 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Creating image(s)
Apr 14 13:23:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "/opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "/opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "/opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.144s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.149s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk 1073741824" returned: 0 in 0.053s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Cannot resize image /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG nova.objects.instance [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'migration_context' on Instance uuid 01f10bee-45ba-4541-8af8-e392018ef468 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Ensure instance console log exists: /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:06 user nova-compute[72019]: INFO nova.compute.manager [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Terminating instance
Apr 14 13:23:06 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG nova.network.neutron [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Updating instance_info_cache with network_info: [{"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Releasing lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Successfully created port: 45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-2d928312-81f0-4ecb-9f08-e19a900da0c8 req-b46e0ff7-3c0a-49c3-9356-84171c89e933 service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Received event network-vif-unplugged-4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d928312-81f0-4ecb-9f08-e19a900da0c8 req-b46e0ff7-3c0a-49c3-9356-84171c89e933 service nova] Acquiring lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d928312-81f0-4ecb-9f08-e19a900da0c8 req-b46e0ff7-3c0a-49c3-9356-84171c89e933 service nova] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2d928312-81f0-4ecb-9f08-e19a900da0c8 req-b46e0ff7-3c0a-49c3-9356-84171c89e933 service nova] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-2d928312-81f0-4ecb-9f08-e19a900da0c8 req-b46e0ff7-3c0a-49c3-9356-84171c89e933 service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] No waiting events found dispatching network-vif-unplugged-4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-2d928312-81f0-4ecb-9f08-e19a900da0c8 req-b46e0ff7-3c0a-49c3-9356-84171c89e933 service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Received event network-vif-unplugged-4ded420e-025f-481e-85a1-010b7e3d71f7 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:07 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Instance destroyed successfully.
Apr 14 13:23:07 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lazy-loading 'resources' on Instance uuid 21aa2e30-d383-4f3b-8c40-7a06968ecb8c {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-885871605',display_name='tempest-TestVolumeBootPattern-server-885871605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-885871605',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:21:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-nqr08png',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:21:34Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=21aa2e30-d383-4f3b-8c40-7a06968ecb8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ded420e-025f-481e-85a1-010b7e3d71f7", "address": "fa:16:3e:02:21:53", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ded420e-02", "ovs_interfaceid": "4ded420e-025f-481e-85a1-010b7e3d71f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "4ded420e-025f-481e-85a1-010b7e3d71f7", "address": "fa:16:3e:02:21:53", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ded420e-02", "ovs_interfaceid": "4ded420e-025f-481e-85a1-010b7e3d71f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:21:53,bridge_name='br-int',has_traffic_filtering=True,id=4ded420e-025f-481e-85a1-010b7e3d71f7,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ded420e-02') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG os_vif [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:21:53,bridge_name='br-int',has_traffic_filtering=True,id=4ded420e-025f-481e-85a1-010b7e3d71f7,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ded420e-02') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ded420e-02, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:07 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Instance destroyed successfully.
Apr 14 13:23:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:07 user nova-compute[72019]: INFO os_vif [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:21:53,bridge_name='br-int',has_traffic_filtering=True,id=4ded420e-025f-481e-85a1-010b7e3d71f7,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ded420e-02')
Apr 14 13:23:07 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Attempting rescue
Apr 14 13:23:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72019) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLBMeSsb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:23:07 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:23:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Instance directory exists: not creating {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 13:23:07 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Creating image(s)
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "/opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "/opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "/opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'trusted_certs' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[509ad17a-f628-476f-9c7c-ed998f89c378]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:23:07 user nova-compute[72019]: No targets found.
Apr 14 13:23:07 user nova-compute[72019]: iSNS:
Apr 14 13:23:07 user nova-compute[72019]: No targets found.
Apr 14 13:23:07 user nova-compute[72019]: STATIC:
Apr 14 13:23:07 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc
Apr 14 13:23:07 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:23:07 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:23:07 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:23:07 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:23:07 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:23:07 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e
Apr 14 13:23:07 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:23:07 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:23:07 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80
Apr 14 13:23:07 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:23:07 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:23:07 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839
Apr 14 13:23:07 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:23:07 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:23:07 user nova-compute[72019]: FIRMWARE:
Apr 14 13:23:07 user nova-compute[72019]: No targets found.
Apr 14 13:23:07 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:23:07 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:23:07 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa309b34-fc46-47c6-a80a-47e93b4417ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e20029-0746-4846-aa32-75823b268bdc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:23:08 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:23:08 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:23:08 user nova-compute[72019]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)
Apr 14 13:23:08 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:23:08 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:23:08 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:23:08 user nova-compute[72019]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 (non-flash)
Apr 14 13:23:08 user nova-compute[72019]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)
Apr 14 13:23:08 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:23:08 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74901c0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80'): ({'sde'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Removing single pathed devices sde {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb13b7d9-bcca-4a5f-8556-018751b58529]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fd8dfe-5c0f-4b05-8afe-4744e5f5962f]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flushing IO for device /dev/sde {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2d0233-d2fc-4d86-88ef-b90a940b780a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.174s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.rescue {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f4add9-7291-4a57-a3cb-f67c56cae50b]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.rescue" returned: 0 in 0.096s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'migration_context' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7853fdf2-ff8a-4109-aebd-533eb60737e4]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Start _get_guest_xml network_info=[{"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "vif_mac": "fa:16:3e:44:e7:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'resources' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'numa_topology' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:23:08 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:23:08 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'vcpu_model' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[becc70cc-97ce-443f-b893-5d1c60544b5f]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80, portal: 172.16.0.220,3260]
Apr 14 13:23:08 user nova-compute[72019]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80, portal: 172.16.0.220,3260] successful.
Apr 14 13:23:08 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1752142358',display_name='tempest-ServerRescueNegativeTestJSON-server-1752142358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1752142358',id=28,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8A7EAZq7tmqrVNMLohBE3mL47WklU/y0g3C4awZJlk7zTwzptrakKyJKVosEv0afOebqhON5GWZWdR8IogeuUlgLuKQn8gHHZsiUBVmRBYXQ+jLuDfBW7YAbRSIevoPw==',key_name='tempest-keypair-1544885661',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:21:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7c8c8f620334166a141ea65525ba2a0',ramdisk_id='',reservation_id='r-w6mtz06d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1698214771',owner_user_name='tempest-ServerRescueNegativeTestJSON-1698214771-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:21:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3948b7c643374bcdbeb34f0f2f790c3c',uuid=775293fc-1773-407d-bf49-fccfe849f440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "vif_mac": "fa:16:3e:44:e7:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converting VIF {"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "vif_mac": "fa:16:3e:44:e7:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:e7:34,bridge_name='br-int',has_traffic_filtering=True,id=aef4cd67-4e33-4456-b7d9-195955db1cdc,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef4cd67-4e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'pci_devices' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4822856c-36c3-4353-ae82-bbd6804ded80 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3404ed40-f14b-43b7-aecd-cab55c8ecda7]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478573.3382955, 65e98ad1-3573-4dce-b9de-bbb1c36ed02e => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:23:08 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] VM Stopped (Lifecycle Event)
Apr 14 13:23:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== disconnect_volume: return (458ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:23:08 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Deleting instance files /opt/stack/data/nova/instances/21aa2e30-d383-4f3b-8c40-7a06968ecb8c_del
Apr 14 13:23:08 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Deletion of /opt/stack/data/nova/instances/21aa2e30-d383-4f3b-8c40-7a06968ecb8c_del complete
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:23:08 user nova-compute[72019]:   <uuid>775293fc-1773-407d-bf49-fccfe849f440</uuid>
Apr 14 13:23:08 user nova-compute[72019]:   <name>instance-0000001c</name>
Apr 14 13:23:08 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:23:08 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:23:08 user nova-compute[72019]:   <metadata>
Apr 14 13:23:08 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:23:08 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:23:08 user nova-compute[72019]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1752142358</nova:name>
Apr 14 13:23:08 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:23:08</nova:creationTime>
Apr 14 13:23:08 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:23:08 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:23:08 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:23:08 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:23:08 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:23:08 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:23:08 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:23:08 user nova-compute[72019]:       <nova:owner>
Apr 14 13:23:08 user nova-compute[72019]:         <nova:user uuid="3948b7c643374bcdbeb34f0f2f790c3c">tempest-ServerRescueNegativeTestJSON-1698214771-project-member</nova:user>
Apr 14 13:23:08 user nova-compute[72019]:         <nova:project uuid="a7c8c8f620334166a141ea65525ba2a0">tempest-ServerRescueNegativeTestJSON-1698214771</nova:project>
Apr 14 13:23:08 user nova-compute[72019]:       </nova:owner>
Apr 14 13:23:08 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:23:08 user nova-compute[72019]:       <nova:ports>
Apr 14 13:23:08 user nova-compute[72019]:         <nova:port uuid="aef4cd67-4e33-4456-b7d9-195955db1cdc">
Apr 14 13:23:08 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 13:23:08 user nova-compute[72019]:         </nova:port>
Apr 14 13:23:08 user nova-compute[72019]:       </nova:ports>
Apr 14 13:23:08 user nova-compute[72019]:     </nova:instance>
Apr 14 13:23:08 user nova-compute[72019]:   </metadata>
Apr 14 13:23:08 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:23:08 user nova-compute[72019]:     <system>
Apr 14 13:23:08 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:23:08 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:23:08 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:23:08 user nova-compute[72019]:       <entry name="serial">775293fc-1773-407d-bf49-fccfe849f440</entry>
Apr 14 13:23:08 user nova-compute[72019]:       <entry name="uuid">775293fc-1773-407d-bf49-fccfe849f440</entry>
Apr 14 13:23:08 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:23:08 user nova-compute[72019]:     </system>
Apr 14 13:23:08 user nova-compute[72019]:   </sysinfo>
Apr 14 13:23:08 user nova-compute[72019]:   <os>
Apr 14 13:23:08 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:23:08 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:23:08 user nova-compute[72019]:   </os>
Apr 14 13:23:08 user nova-compute[72019]:   <features>
Apr 14 13:23:08 user nova-compute[72019]:     <acpi/>
Apr 14 13:23:08 user nova-compute[72019]:     <apic/>
Apr 14 13:23:08 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:23:08 user nova-compute[72019]:   </features>
Apr 14 13:23:08 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:23:08 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:23:08 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:23:08 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:23:08 user nova-compute[72019]:   </clock>
Apr 14 13:23:08 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:23:08 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:23:08 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:23:08 user nova-compute[72019]:   </cpu>
Apr 14 13:23:08 user nova-compute[72019]:   <devices>
Apr 14 13:23:08 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:23:08 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:23:08 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.rescue"/>
Apr 14 13:23:08 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:23:08 user nova-compute[72019]:     </disk>
Apr 14 13:23:08 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:23:08 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:23:08 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk"/>
Apr 14 13:23:08 user nova-compute[72019]:       <target dev="vdb" bus="virtio"/>
Apr 14 13:23:08 user nova-compute[72019]:     </disk>
Apr 14 13:23:08 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:23:08 user nova-compute[72019]:       <mac address="fa:16:3e:44:e7:34"/>
Apr 14 13:23:08 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:23:08 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:23:08 user nova-compute[72019]:       <target dev="tapaef4cd67-4e"/>
Apr 14 13:23:08 user nova-compute[72019]:     </interface>
Apr 14 13:23:08 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:23:08 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/console.log" append="off"/>
Apr 14 13:23:08 user nova-compute[72019]:     </serial>
Apr 14 13:23:08 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:23:08 user nova-compute[72019]:     <video>
Apr 14 13:23:08 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:23:08 user nova-compute[72019]:     </video>
Apr 14 13:23:08 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:23:08 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:23:08 user nova-compute[72019]:     </rng>
Apr 14 13:23:08 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:23:08 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:23:08 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:23:08 user nova-compute[72019]:     </memballoon>
Apr 14 13:23:08 user nova-compute[72019]:   </devices>
Apr 14 13:23:08 user nova-compute[72019]: </domain>
Apr 14 13:23:08 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:23:08 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Instance destroyed successfully.
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-868fedb0-a3d6-448a-9a7b-fe7c056360e1 None None] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:23:08 user nova-compute[72019]: INFO nova.compute.manager [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Took 1.79 seconds to destroy the instance on the hypervisor.
Apr 14 13:23:08 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:23:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] No VIF found with MAC fa:16:3e:44:e7:34, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Successfully updated port: 45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "refresh_cache-01f10bee-45ba-4541-8af8-e392018ef468" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquired lock "refresh_cache-01f10bee-45ba-4541-8af8-e392018ef468" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Received event network-vif-plugged-4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Acquiring lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] No waiting events found dispatching network-vif-plugged-4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:23:09 user nova-compute[72019]: WARNING nova.compute.manager [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Received unexpected event network-vif-plugged-4ded420e-025f-481e-85a1-010b7e3d71f7 for instance with vm_state active and task_state deleting.
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-vif-unplugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] No waiting events found dispatching network-vif-unplugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:23:09 user nova-compute[72019]: WARNING nova.compute.manager [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received unexpected event network-vif-unplugged-aef4cd67-4e33-4456-b7d9-195955db1cdc for instance with vm_state active and task_state rescuing.
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] No waiting events found dispatching network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:23:09 user nova-compute[72019]: WARNING nova.compute.manager [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received unexpected event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc for instance with vm_state active and task_state rescuing.
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Received event network-vif-plugged-4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Acquiring lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] No waiting events found dispatching network-vif-plugged-4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:23:09 user nova-compute[72019]: WARNING nova.compute.manager [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Received unexpected event network-vif-plugged-4ded420e-025f-481e-85a1-010b7e3d71f7 for instance with vm_state active and task_state deleting.
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Received event network-changed-45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Refreshing instance network info cache due to event network-changed-45024c25-a182-4df9-bec0-ab8dc8354659. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Acquiring lock "refresh_cache-01f10bee-45ba-4541-8af8-e392018ef468" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:23:09 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Took 1.25 seconds to deallocate network for instance.
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Updating instance_info_cache with network_info: [{"id": "45024c25-a182-4df9-bec0-ab8dc8354659", "address": "fa:16:3e:35:6e:44", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45024c25-a1", "ovs_interfaceid": "45024c25-a182-4df9-bec0-ab8dc8354659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Releasing lock "refresh_cache-01f10bee-45ba-4541-8af8-e392018ef468" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Instance network_info: |[{"id": "45024c25-a182-4df9-bec0-ab8dc8354659", "address": "fa:16:3e:35:6e:44", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45024c25-a1", "ovs_interfaceid": "45024c25-a182-4df9-bec0-ab8dc8354659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Acquired lock "refresh_cache-01f10bee-45ba-4541-8af8-e392018ef468" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.network.neutron [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Refreshing network info cache for port 45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Start _get_guest_xml network_info=[{"id": "45024c25-a182-4df9-bec0-ab8dc8354659", "address": "fa:16:3e:35:6e:44", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45024c25-a1", "ovs_interfaceid": "45024c25-a182-4df9-bec0-ab8dc8354659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:23:09 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:23:09 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-726689788',display_name='tempest-AttachVolumeNegativeTest-server-726689788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-726689788',id=32,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg8dU1qqZxvIoy7B9MZfr1N9Qmp8/sb1Cp3tVcrzGMGiIWPn7W4DzC4kWzTVoUug8LQZNSohYWd+IFsh8GZ354HHZ2I1rxyDiEJR3c48LmMMe9YviOl0aUKv762EOVERg==',key_name='tempest-keypair-1578112597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6833a69217034c4d85ff10bf8aa2fa5c',ramdisk_id='',reservation_id='r-gssv3g00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-893959880',owner_user_name='tempest-AttachVolumeNegativeTest-893959880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65812c6559684eddbdde33cd64ca1fba',uuid=01f10bee-45ba-4541-8af8-e392018ef468,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45024c25-a182-4df9-bec0-ab8dc8354659", "address": "fa:16:3e:35:6e:44", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45024c25-a1", "ovs_interfaceid": "45024c25-a182-4df9-bec0-ab8dc8354659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converting VIF {"id": "45024c25-a182-4df9-bec0-ab8dc8354659", "address": "fa:16:3e:35:6e:44", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45024c25-a1", "ovs_interfaceid": "45024c25-a182-4df9-bec0-ab8dc8354659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=45024c25-a182-4df9-bec0-ab8dc8354659,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45024c25-a1') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.objects.instance [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'pci_devices' on Instance uuid 01f10bee-45ba-4541-8af8-e392018ef468 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:23:09 user nova-compute[72019]:   <uuid>01f10bee-45ba-4541-8af8-e392018ef468</uuid>
Apr 14 13:23:09 user nova-compute[72019]:   <name>instance-00000020</name>
Apr 14 13:23:09 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:23:09 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:23:09 user nova-compute[72019]:   <metadata>
Apr 14 13:23:09 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:23:09 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:23:09 user nova-compute[72019]:       <nova:name>tempest-AttachVolumeNegativeTest-server-726689788</nova:name>
Apr 14 13:23:09 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:23:09</nova:creationTime>
Apr 14 13:23:09 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:23:09 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:23:09 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:23:09 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:23:09 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:23:09 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:23:09 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:23:09 user nova-compute[72019]:       <nova:owner>
Apr 14 13:23:09 user nova-compute[72019]:         <nova:user uuid="65812c6559684eddbdde33cd64ca1fba">tempest-AttachVolumeNegativeTest-893959880-project-member</nova:user>
Apr 14 13:23:09 user nova-compute[72019]:         <nova:project uuid="6833a69217034c4d85ff10bf8aa2fa5c">tempest-AttachVolumeNegativeTest-893959880</nova:project>
Apr 14 13:23:09 user nova-compute[72019]:       </nova:owner>
Apr 14 13:23:09 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:23:09 user nova-compute[72019]:       <nova:ports>
Apr 14 13:23:09 user nova-compute[72019]:         <nova:port uuid="45024c25-a182-4df9-bec0-ab8dc8354659">
Apr 14 13:23:09 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 13:23:09 user nova-compute[72019]:         </nova:port>
Apr 14 13:23:09 user nova-compute[72019]:       </nova:ports>
Apr 14 13:23:09 user nova-compute[72019]:     </nova:instance>
Apr 14 13:23:09 user nova-compute[72019]:   </metadata>
Apr 14 13:23:09 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:23:09 user nova-compute[72019]:     <system>
Apr 14 13:23:09 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:23:09 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:23:09 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:23:09 user nova-compute[72019]:       <entry name="serial">01f10bee-45ba-4541-8af8-e392018ef468</entry>
Apr 14 13:23:09 user nova-compute[72019]:       <entry name="uuid">01f10bee-45ba-4541-8af8-e392018ef468</entry>
Apr 14 13:23:09 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:23:09 user nova-compute[72019]:     </system>
Apr 14 13:23:09 user nova-compute[72019]:   </sysinfo>
Apr 14 13:23:09 user nova-compute[72019]:   <os>
Apr 14 13:23:09 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:23:09 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:23:09 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:23:09 user nova-compute[72019]:   </os>
Apr 14 13:23:09 user nova-compute[72019]:   <features>
Apr 14 13:23:09 user nova-compute[72019]:     <acpi/>
Apr 14 13:23:09 user nova-compute[72019]:     <apic/>
Apr 14 13:23:09 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:23:09 user nova-compute[72019]:   </features>
Apr 14 13:23:09 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:23:09 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:23:09 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:23:09 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:23:09 user nova-compute[72019]:   </clock>
Apr 14 13:23:09 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:23:09 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:23:09 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:23:09 user nova-compute[72019]:   </cpu>
Apr 14 13:23:09 user nova-compute[72019]:   <devices>
Apr 14 13:23:09 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:23:09 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:23:09 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk"/>
Apr 14 13:23:09 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:23:09 user nova-compute[72019]:     </disk>
Apr 14 13:23:09 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:23:09 user nova-compute[72019]:       <mac address="fa:16:3e:35:6e:44"/>
Apr 14 13:23:09 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:23:09 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:23:09 user nova-compute[72019]:       <target dev="tap45024c25-a1"/>
Apr 14 13:23:09 user nova-compute[72019]:     </interface>
Apr 14 13:23:09 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:23:09 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/console.log" append="off"/>
Apr 14 13:23:09 user nova-compute[72019]:     </serial>
Apr 14 13:23:09 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:23:09 user nova-compute[72019]:     <video>
Apr 14 13:23:09 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:23:09 user nova-compute[72019]:     </video>
Apr 14 13:23:09 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:23:09 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:23:09 user nova-compute[72019]:     </rng>
Apr 14 13:23:09 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:23:09 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:23:09 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:23:09 user nova-compute[72019]:     </memballoon>
Apr 14 13:23:09 user nova-compute[72019]:   </devices>
Apr 14 13:23:09 user nova-compute[72019]: </domain>
Apr 14 13:23:09 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-726689788',display_name='tempest-AttachVolumeNegativeTest-server-726689788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-726689788',id=32,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg8dU1qqZxvIoy7B9MZfr1N9Qmp8/sb1Cp3tVcrzGMGiIWPn7W4DzC4kWzTVoUug8LQZNSohYWd+IFsh8GZ354HHZ2I1rxyDiEJR3c48LmMMe9YviOl0aUKv762EOVERg==',key_name='tempest-keypair-1578112597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6833a69217034c4d85ff10bf8aa2fa5c',ramdisk_id='',reservation_id='r-gssv3g00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-893959880',owner_user_name='tempest-AttachVolumeNegativeTest-893959880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65812c6559684eddbdde33cd64ca1fba',uuid=01f10bee-45ba-4541-8af8-e392018ef468,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45024c25-a182-4df9-bec0-ab8dc8354659", "address": "fa:16:3e:35:6e:44", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45024c25-a1", "ovs_interfaceid": "45024c25-a182-4df9-bec0-ab8dc8354659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converting VIF {"id": "45024c25-a182-4df9-bec0-ab8dc8354659", "address": "fa:16:3e:35:6e:44", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45024c25-a1", "ovs_interfaceid": "45024c25-a182-4df9-bec0-ab8dc8354659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=45024c25-a182-4df9-bec0-ab8dc8354659,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45024c25-a1') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG os_vif [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=45024c25-a182-4df9-bec0-ab8dc8354659,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45024c25-a1') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45024c25-a1, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45024c25-a1, col_values=(('external_ids', {'iface-id': '45024c25-a182-4df9-bec0-ab8dc8354659', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:6e:44', 'vm-uuid': '01f10bee-45ba-4541-8af8-e392018ef468'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:09 user nova-compute[72019]: INFO os_vif [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=45024c25-a182-4df9-bec0-ab8dc8354659,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45024c25-a1')
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:23:09 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No VIF found with MAC fa:16:3e:35:6e:44, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:23:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:10 user nova-compute[72019]: DEBUG nova.network.neutron [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Updated VIF entry in instance network info cache for port 45024c25-a182-4df9-bec0-ab8dc8354659. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:23:10 user nova-compute[72019]: DEBUG nova.network.neutron [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Updating instance_info_cache with network_info: [{"id": "45024c25-a182-4df9-bec0-ab8dc8354659", "address": "fa:16:3e:35:6e:44", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45024c25-a1", "ovs_interfaceid": "45024c25-a182-4df9-bec0-ab8dc8354659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:23:10 user nova-compute[72019]: INFO nova.compute.manager [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Took 0.88 seconds to detach 1 volumes for instance.
Apr 14 13:23:10 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Deleting volume: 4822856c-36c3-4353-ae82-bbd6804ded80 {{(pid=72019) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 13:23:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Releasing lock "refresh_cache-01f10bee-45ba-4541-8af8-e392018ef468" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:23:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:11 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Deleted allocations for instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c
Apr 14 13:23:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "21aa2e30-d383-4f3b-8c40-7a06968ecb8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.666s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG nova.compute.manager [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Received event network-vif-deleted-4ded420e-025f-481e-85a1-010b7e3d71f7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG nova.compute.manager [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG nova.compute.manager [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] No waiting events found dispatching network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:23:11 user nova-compute[72019]: WARNING nova.compute.manager [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received unexpected event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc for instance with vm_state active and task_state rescuing.
Apr 14 13:23:11 user nova-compute[72019]: DEBUG nova.compute.manager [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG nova.compute.manager [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] No waiting events found dispatching network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:23:11 user nova-compute[72019]: WARNING nova.compute.manager [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received unexpected event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc for instance with vm_state active and task_state rescuing.
Apr 14 13:23:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for 775293fc-1773-407d-bf49-fccfe849f440 due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478593.217994, 775293fc-1773-407d-bf49-fccfe849f440 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:23:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] VM Resumed (Lifecycle Event)
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:23:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478593.221938, 775293fc-1773-407d-bf49-fccfe849f440 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:23:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] VM Started (Lifecycle Event)
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:23:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Received event network-vif-plugged-45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] Acquiring lock "01f10bee-45ba-4541-8af8-e392018ef468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] Lock "01f10bee-45ba-4541-8af8-e392018ef468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] Lock "01f10bee-45ba-4541-8af8-e392018ef468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] No waiting events found dispatching network-vif-plugged-45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:23:13 user nova-compute[72019]: WARNING nova.compute.manager [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Received unexpected event network-vif-plugged-45024c25-a182-4df9-bec0-ab8dc8354659 for instance with vm_state building and task_state spawning.
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Received event network-vif-plugged-45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] Acquiring lock "01f10bee-45ba-4541-8af8-e392018ef468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] Lock "01f10bee-45ba-4541-8af8-e392018ef468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] Lock "01f10bee-45ba-4541-8af8-e392018ef468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] No waiting events found dispatching network-vif-plugged-45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:23:13 user nova-compute[72019]: WARNING nova.compute.manager [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Received unexpected event network-vif-plugged-45024c25-a182-4df9-bec0-ab8dc8354659 for instance with vm_state building and task_state spawning.
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478593.7368443, 01f10bee-45ba-4541-8af8-e392018ef468 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:23:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] VM Resumed (Lifecycle Event)
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:23:13 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Instance spawned successfully.
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:23:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478593.738322, 01f10bee-45ba-4541-8af8-e392018ef468 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:23:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] VM Started (Lifecycle Event)
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:23:13 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:23:13 user nova-compute[72019]: INFO nova.compute.manager [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Took 8.10 seconds to spawn the instance on the hypervisor.
Apr 14 13:23:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:23:13 user nova-compute[72019]: INFO nova.compute.manager [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Took 8.85 seconds to build instance.
Apr 14 13:23:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "01f10bee-45ba-4541-8af8-e392018ef468" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.952s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:22 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478587.8031948, 21aa2e30-d383-4f3b-8c40-7a06968ecb8c => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:23:22 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] VM Stopped (Lifecycle Event)
Apr 14 13:23:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-23bb7004-8ae5-41d0-92e8-807a5ff17ee1 None None] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:24 user nova-compute[72019]: INFO nova.compute.manager [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Detaching volume 1fe1d12d-36df-40a9-a5dd-ce6280d95839
Apr 14 13:23:24 user nova-compute[72019]: INFO nova.virt.block_device [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Attempting to driver detach volume 1fe1d12d-36df-40a9-a5dd-ce6280d95839 from mountpoint /dev/vdc
Apr 14 13:23:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Attempting to detach device vdc from instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:23:24 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:23:24 user nova-compute[72019]:   <source dev="/dev/sdf"/>
Apr 14 13:23:24 user nova-compute[72019]:   <target dev="vdc" bus="virtio"/>
Apr 14 13:23:24 user nova-compute[72019]:   <serial>1fe1d12d-36df-40a9-a5dd-ce6280d95839</serial>
Apr 14 13:23:24 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 13:23:24 user nova-compute[72019]: </disk>
Apr 14 13:23:24 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:23:24 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Successfully detached device vdc from instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b from the persistent domain config.
Apr 14 13:23:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:23:24 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:23:24 user nova-compute[72019]:   <source dev="/dev/sdf"/>
Apr 14 13:23:24 user nova-compute[72019]:   <target dev="vdc" bus="virtio"/>
Apr 14 13:23:24 user nova-compute[72019]:   <serial>1fe1d12d-36df-40a9-a5dd-ce6280d95839</serial>
Apr 14 13:23:24 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 13:23:24 user nova-compute[72019]: </disk>
Apr 14 13:23:24 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478604.7882245, 1a866f3f-b709-4286-8cef-8e3b35f26d0b => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:23:24 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Successfully detached device vdc from instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b from the live domain config.
Apr 14 13:23:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWZgdINz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:23:24 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ba594d-c579-47d4-a968-ec9cc75c66f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:23:24 user nova-compute[72019]: No targets found.
Apr 14 13:23:24 user nova-compute[72019]: iSNS:
Apr 14 13:23:24 user nova-compute[72019]: No targets found.
Apr 14 13:23:24 user nova-compute[72019]: STATIC:
Apr 14 13:23:24 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc
Apr 14 13:23:24 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:23:24 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:23:24 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:23:24 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:23:24 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:23:24 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e
Apr 14 13:23:24 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:23:24 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:23:24 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839
Apr 14 13:23:24 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:23:24 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:23:24 user nova-compute[72019]: FIRMWARE:
Apr 14 13:23:24 user nova-compute[72019]: No targets found.
Apr 14 13:23:24 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:23:24 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:23:24 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[57941392-e3d9-44c9-afb0-25da07dac1a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69c9ea3-ebe5-4e20-8b79-a7a955a758ac]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:23:24 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:23:24 user nova-compute[72019]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)
Apr 14 13:23:24 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:23:24 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:23:24 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:23:24 user nova-compute[72019]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 (non-flash)
Apr 14 13:23:24 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:23:24 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74905b52d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839'): ({'sdf'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Removing single pathed devices sdf {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7464f26-bcfb-4534-b983-1704249dcbdb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb2c7c6-d2d5-4449-829b-760da5ed0a73]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Flushing IO for device /dev/sdf {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eabe138-3d14-464e-be89-c7382ba1b0b5]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f21435-4d07-4b5e-a760-6777232148fa]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] SCSI volumes sdf have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:23:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[25696b81-8fa2-4bd2-b513-6f43e561fa85]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[29164921-7ba3-4e53-aedf-051ab573a185]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839, portal: 172.16.0.220,3260]
Apr 14 13:23:25 user nova-compute[72019]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839, portal: 172.16.0.220,3260] successful.
Apr 14 13:23:25 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe1d12d-36df-40a9-a5dd-ce6280d95839 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[985431b6-9548-499f-b371-bf4606bce7ca]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] <== disconnect_volume: return (304ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG nova.objects.instance [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'flavor' on Instance uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:23:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.760s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:29 user nova-compute[72019]: INFO nova.compute.manager [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Unrescuing
Apr 14 13:23:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:23:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquired lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:23:29 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:23:29 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:23:29 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:23:29 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:23:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-847e2db8-10a7-416b-ae22-1c75b6d37817" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:23:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-847e2db8-10a7-416b-ae22-1c75b6d37817" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:23:29 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:23:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Updating instance_info_cache with network_info: [{"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Releasing lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG nova.objects.instance [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'flavor' on Instance uuid b7cdf352-a517-4296-bc70-400836915095 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Updating instance_info_cache with network_info: [{"id": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "address": "fa:16:3e:76:9e:86", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf35aee5-c4", "ovs_interfaceid": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-847e2db8-10a7-416b-ae22-1c75b6d37817" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-e56a5014-44f9-4a11-a658-917f17d6d02d req-5234bcf1-9290-4036-ab3a-6a06fbc6c013 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-vif-unplugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e56a5014-44f9-4a11-a658-917f17d6d02d req-5234bcf1-9290-4036-ab3a-6a06fbc6c013 service nova] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e56a5014-44f9-4a11-a658-917f17d6d02d req-5234bcf1-9290-4036-ab3a-6a06fbc6c013 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e56a5014-44f9-4a11-a658-917f17d6d02d req-5234bcf1-9290-4036-ab3a-6a06fbc6c013 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-e56a5014-44f9-4a11-a658-917f17d6d02d req-5234bcf1-9290-4036-ab3a-6a06fbc6c013 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] No waiting events found dispatching network-vif-unplugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:23:30 user nova-compute[72019]: WARNING nova.compute.manager [req-e56a5014-44f9-4a11-a658-917f17d6d02d req-5234bcf1-9290-4036-ab3a-6a06fbc6c013 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received unexpected event network-vif-unplugged-c5258996-381d-45a2-8447-784b03a4e32e for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:23:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:30 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: b7cdf352-a517-4296-bc70-400836915095] Instance destroyed successfully.
Apr 14 13:23:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:31 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] No waiting events found dispatching network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:23:32 user nova-compute[72019]: WARNING nova.compute.manager [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received unexpected event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:23:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] No waiting events found dispatching network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:23:32 user nova-compute[72019]: WARNING nova.compute.manager [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received unexpected event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:23:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:23:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.manager [req-7b8f1c53-da90-433f-8cf8-ac71c7900016 req-c2924b50-0d9f-4e4f-87fb-6103e3f7a32d service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7b8f1c53-da90-433f-8cf8-ac71c7900016 req-c2924b50-0d9f-4e4f-87fb-6103e3f7a32d service nova] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7b8f1c53-da90-433f-8cf8-ac71c7900016 req-c2924b50-0d9f-4e4f-87fb-6103e3f7a32d service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7b8f1c53-da90-433f-8cf8-ac71c7900016 req-c2924b50-0d9f-4e4f-87fb-6103e3f7a32d service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.manager [req-7b8f1c53-da90-433f-8cf8-ac71c7900016 req-c2924b50-0d9f-4e4f-87fb-6103e3f7a32d service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] No waiting events found dispatching network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:23:35 user nova-compute[72019]: WARNING nova.compute.manager [req-7b8f1c53-da90-433f-8cf8-ac71c7900016 req-c2924b50-0d9f-4e4f-87fb-6103e3f7a32d service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received unexpected event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for b7cdf352-a517-4296-bc70-400836915095 due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478614.4751198, b7cdf352-a517-4296-bc70-400836915095 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:23:35 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] VM Resumed (Lifecycle Event)
Apr 14 13:23:35 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:23:35 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7506MB free_disk=26.09476089477539GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:23:35 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478614.4753473, b7cdf352-a517-4296-bc70-400836915095 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:23:35 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] VM Started (Lifecycle Event)
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 775293fc-1773-407d-bf49-fccfe849f440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 49467859-954f-498d-b520-587c7f38effc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 01f10bee-45ba-4541-8af8-e392018ef468 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing inventories for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Updating ProviderTree inventory for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Updating inventory in ProviderTree for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing aggregate associations for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569, aggregates: None {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 13:23:35 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing trait associations for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 13:23:36 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:23:36 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:23:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:23:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.928s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:23:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:23:36 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Cleaning up deleted instances {{(pid=72019) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 13:23:36 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] There are 0 instances to clean {{(pid=72019) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 13:23:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:23:36 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72019) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 13:23:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:23:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:23:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:23:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:07 user nova-compute[72019]: INFO nova.compute.manager [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Detaching volume 0dc33843-6235-4794-844e-9fc4db46c60e
Apr 14 13:24:07 user nova-compute[72019]: INFO nova.virt.block_device [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Attempting to driver detach volume 0dc33843-6235-4794-844e-9fc4db46c60e from mountpoint /dev/vdb
Apr 14 13:24:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Attempting to detach device vdb from instance 6e646c88-579e-4ea1-b987-da1c7194a064 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:24:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:24:07 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:24:07 user nova-compute[72019]:   <source dev="/dev/sdd"/>
Apr 14 13:24:07 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:24:07 user nova-compute[72019]:   <serial>0dc33843-6235-4794-844e-9fc4db46c60e</serial>
Apr 14 13:24:07 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 13:24:07 user nova-compute[72019]: </disk>
Apr 14 13:24:07 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:24:07 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully detached device vdb from instance 6e646c88-579e-4ea1-b987-da1c7194a064 from the persistent domain config.
Apr 14 13:24:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e646c88-579e-4ea1-b987-da1c7194a064 from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:24:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:24:07 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:24:07 user nova-compute[72019]:   <source dev="/dev/sdd"/>
Apr 14 13:24:07 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:24:07 user nova-compute[72019]:   <serial>0dc33843-6235-4794-844e-9fc4db46c60e</serial>
Apr 14 13:24:07 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 13:24:07 user nova-compute[72019]: </disk>
Apr 14 13:24:07 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478648.2593586, 6e646c88-579e-4ea1-b987-da1c7194a064 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:24:08 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully detached device vdb from instance 6e646c88-579e-4ea1-b987-da1c7194a064 from the live domain config.
Apr 14 13:24:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGdkAJCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:24:08 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2791ecca-8d6f-4668-ac1c-11363f4f6078]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:24:08 user nova-compute[72019]: No targets found.
Apr 14 13:24:08 user nova-compute[72019]: iSNS:
Apr 14 13:24:08 user nova-compute[72019]: No targets found.
Apr 14 13:24:08 user nova-compute[72019]: STATIC:
Apr 14 13:24:08 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc
Apr 14 13:24:08 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:24:08 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:24:08 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:24:08 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:24:08 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:24:08 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e
Apr 14 13:24:08 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:24:08 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:24:08 user nova-compute[72019]: FIRMWARE:
Apr 14 13:24:08 user nova-compute[72019]: No targets found.
Apr 14 13:24:08 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:24:08 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:24:08 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b05a7ce-552a-42fb-ade0-6ccdd8787756]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dc04e7-bc18-4a5e-b950-9f563007a3a2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:08 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:24:08 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:08 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:08 user nova-compute[72019]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e (non-flash)
Apr 14 13:24:08 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:08 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74901c31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e'): ({'sdd'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Removing single pathed devices sdd {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea4d191-5c23-4935-8498-165e772bcb1b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a2dc35-0755-439e-b5c8-1202724668fd]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flushing IO for device /dev/sdd {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[db21110f-f3fc-4738-aae4-11a935b71b33]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[600dfe26-69eb-4388-86ed-645572addd19]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] SCSI volumes sdd have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0ed0de-eb6b-421e-80cf-a9eb2ecb74e0]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6791e457-4808-4cab-bc99-75f1663a1cfe]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260]
Apr 14 13:24:08 user nova-compute[72019]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e, portal: 172.16.0.220,3260] successful.
Apr 14 13:24:08 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc33843-6235-4794-844e-9fc4db46c60e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4f9e6d-bc05-4de0-b2b9-281b212f9060]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== disconnect_volume: return (328ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "82d3b319-f069-48b6-bb53-32835bc6a2e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:08 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:24:08 user nova-compute[72019]: INFO nova.compute.claims [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Claim successful on node user
Apr 14 13:24:09 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG nova.objects.instance [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'flavor' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG nova.network.neutron [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:24:09 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.919s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:24:09 user nova-compute[72019]: INFO nova.virt.block_device [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Booting with volume fa06c410-d2f3-4211-98a9-d8bae7d21b29 at /dev/vda
Apr 14 13:24:09 user nova-compute[72019]: DEBUG nova.policy [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG os_brick.utils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f313fc5-35ee-4cf6-9685-5d52a52cfad3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6701969e-a4ab-4aa8-ad25-72a46b3dec4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e298317-0488-4828-9312-1165c0deced6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[357bb74f-4936-420d-871a-2354fdbac61a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:24:09 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:24:09 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cee09d-99ea-4204-85a8-3d5265b2f8e1]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG os_brick.utils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:24:09 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Updating existing volume attachment record: 944b4b42-2a68-41ba-adb4-4316881245fd {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:24:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:10 user nova-compute[72019]: DEBUG nova.network.neutron [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Successfully created port: 6f5b7a99-53da-4ad1-b18a-d4b62d359e1b {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG nova.network.neutron [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Successfully updated port: 6f5b7a99-53da-4ad1-b18a-d4b62d359e1b {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "refresh_cache-82d3b319-f069-48b6-bb53-32835bc6a2e3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquired lock "refresh_cache-82d3b319-f069-48b6-bb53-32835bc6a2e3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG nova.network.neutron [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG nova.compute.manager [req-c7b96525-3a2c-4e98-8936-f22c897b205f req-7e8432a2-341e-4f83-aa0a-498d0abc9ba4 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Received event network-changed-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG nova.compute.manager [req-c7b96525-3a2c-4e98-8936-f22c897b205f req-7e8432a2-341e-4f83-aa0a-498d0abc9ba4 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Refreshing instance network info cache due to event network-changed-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c7b96525-3a2c-4e98-8936-f22c897b205f req-7e8432a2-341e-4f83-aa0a-498d0abc9ba4 service nova] Acquiring lock "refresh_cache-82d3b319-f069-48b6-bb53-32835bc6a2e3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG nova.network.neutron [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG nova.network.neutron [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Updating instance_info_cache with network_info: [{"id": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "address": "fa:16:3e:7e:24:9e", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5b7a99-53", "ovs_interfaceid": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Releasing lock "refresh_cache-82d3b319-f069-48b6-bb53-32835bc6a2e3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Instance network_info: |[{"id": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "address": "fa:16:3e:7e:24:9e", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5b7a99-53", "ovs_interfaceid": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c7b96525-3a2c-4e98-8936-f22c897b205f req-7e8432a2-341e-4f83-aa0a-498d0abc9ba4 service nova] Acquired lock "refresh_cache-82d3b319-f069-48b6-bb53-32835bc6a2e3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG nova.network.neutron [req-c7b96525-3a2c-4e98-8936-f22c897b205f req-7e8432a2-341e-4f83-aa0a-498d0abc9ba4 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Refreshing network info cache for port 6f5b7a99-53da-4ad1-b18a-d4b62d359e1b {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG nova.network.neutron [req-c7b96525-3a2c-4e98-8936-f22c897b205f req-7e8432a2-341e-4f83-aa0a-498d0abc9ba4 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Updated VIF entry in instance network info cache for port 6f5b7a99-53da-4ad1-b18a-d4b62d359e1b. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG nova.network.neutron [req-c7b96525-3a2c-4e98-8936-f22c897b205f req-7e8432a2-341e-4f83-aa0a-498d0abc9ba4 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Updating instance_info_cache with network_info: [{"id": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "address": "fa:16:3e:7e:24:9e", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5b7a99-53", "ovs_interfaceid": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:24:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c7b96525-3a2c-4e98-8936-f22c897b205f req-7e8432a2-341e-4f83-aa0a-498d0abc9ba4 service nova] Releasing lock "refresh_cache-82d3b319-f069-48b6-bb53-32835bc6a2e3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:24:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "49467859-954f-498d-b520-587c7f38effc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "49467859-954f-498d-b520-587c7f38effc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:12 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'flavor' on Instance uuid 49467859-954f-498d-b520-587c7f38effc {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "49467859-954f-498d-b520-587c7f38effc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "49467859-954f-498d-b520-587c7f38effc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "49467859-954f-498d-b520-587c7f38effc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:12 user nova-compute[72019]: INFO nova.compute.manager [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Attaching volume fcdfe359-4681-4ebf-847d-85edfd26edc0 to /dev/vdb
Apr 14 13:24:12 user nova-compute[72019]: DEBUG os_brick.utils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef9784e-1775-4307-b2ed-f7330a0deda0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b5daf4-0e58-4d29-b111-f5a281afb4ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda826cc-d444-452d-9bdf-4dc4abb1168d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eb69b6-a8b0-4d30-be16-2abd1a808139]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:24:13 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:24:13 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[be60703e-ccd4-4a2c-8a29-3acca8a6b44b]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG os_brick.utils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:24:13 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Updating existing volume attachment record: 3e3f3764-37f9-4b6a-bc6b-37858f530c43 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:14 user nova-compute[72019]: INFO nova.compute.manager [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Terminating instance
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:24:14 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Creating image(s)
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Ensure instance console log exists: /opt/stack/data/nova/instances/82d3b319-f069-48b6-bb53-32835bc6a2e3/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Start _get_guest_xml network_info=[{"id": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "address": "fa:16:3e:7e:24:9e", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5b7a99-53", "ovs_interfaceid": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '944b4b42-2a68-41ba-adb4-4316881245fd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJdLctnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82d3b319-f069-48b6-bb53-32835bc6a2e3', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa06c410-d2f3-4211-98a9-d8bae7d21b29', 'serial': 'fa06c410-d2f3-4211-98a9-d8bae7d21b29'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:24:14 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:24:14 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJdLctnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:24:14 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:24:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:24:14 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:24:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:24:14 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[428e7623-64ca-4d05-9415-c39d0e9dc669]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:24:14 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd725a3-1120-4e01-93a0-4a6d0cc10922]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29] added
Apr 14 13:24:14 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ad64b1-b775-4f12-a3fa-1417e179b4af]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2defa5d5-fbfe-4d61-9383-8358c4685fd9]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJdLctnU {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJdLctnU" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5399d446-f73f-406f-9193-b7d1318c498d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lJdLctnU'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4802ff-38a4-4b29-8c2a-7425b08bd18d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-421b0021-2ec1-48fc-9594-33c7f585f5ad req-79d15000-5fa3-4e45-a08b-c00d3c03e754 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-vif-unplugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-421b0021-2ec1-48fc-9594-33c7f585f5ad req-79d15000-5fa3-4e45-a08b-c00d3c03e754 service nova] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-421b0021-2ec1-48fc-9594-33c7f585f5ad req-79d15000-5fa3-4e45-a08b-c00d3c03e754 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-421b0021-2ec1-48fc-9594-33c7f585f5ad req-79d15000-5fa3-4e45-a08b-c00d3c03e754 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-421b0021-2ec1-48fc-9594-33c7f585f5ad req-79d15000-5fa3-4e45-a08b-c00d3c03e754 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] No waiting events found dispatching network-vif-unplugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-421b0021-2ec1-48fc-9594-33c7f585f5ad req-79d15000-5fa3-4e45-a08b-c00d3c03e754 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-vif-unplugged-351008cc-2fb2-4fa8-997d-96ea40263d9d for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[008a0e68-d0c6-4bad-b652-dc26b9f25b6e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:14 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:14 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:14 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:14 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:24:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17fe4d3-0f9f-4396-ab7c-80fdbb33cab0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29, portal: 172.16.0.220,3260]
Apr 14 13:24:15 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29, portal: 172.16.0.220,3260] successful.
Apr 14 13:24:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b36dc1-b6c5-4810-ac7c-060af47a9a38]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88317ee-0462-44cc-b89d-6c1012fa51d9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:15 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:15 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:15 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:15 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5d3ccb-02d1-44ae-b2b4-ba09d6ee55fa]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJdLctnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:15 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Instance destroyed successfully.
Apr 14 13:24:15 user nova-compute[72019]: DEBUG nova.objects.instance [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'resources' on Instance uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2054124847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2054124847',id=23,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe8+NQxdd30Id654GBmcPwxA0JUpEg+Hy4COx6Fb893eVwtn8PELZv6pRPgbhjQTvkkY11PVtxzwFy1OaWZde1spOAQMgX1ADyyiK3GMyy+wZuqUsAbmtL2UTWG2YF/Rg==',key_name='tempest-keypair-1859762998',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:21:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f0fee50983a4e31b1689dc77b1c4db1',ramdisk_id='',reservation_id='r-bh3fqraz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1344633518',owner_user_name='tempest-AttachVolumeShelveTestJSON-1344633518-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:21:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04370605aec40a0a53a080c1e8bf8a8',uuid=1a866f3f-b709-4286-8cef-8e3b35f26d0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converting VIF {"id": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "address": "fa:16:3e:45:74:1b", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351008cc-2f", "ovs_interfaceid": "351008cc-2fb2-4fa8-997d-96ea40263d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:74:1b,bridge_name='br-int',has_traffic_filtering=True,id=351008cc-2fb2-4fa8-997d-96ea40263d9d,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351008cc-2f') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG os_vif [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:74:1b,bridge_name='br-int',has_traffic_filtering=True,id=351008cc-2fb2-4fa8-997d-96ea40263d9d,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351008cc-2f') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap351008cc-2f, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:15 user nova-compute[72019]: INFO os_vif [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:74:1b,bridge_name='br-int',has_traffic_filtering=True,id=351008cc-2fb2-4fa8-997d-96ea40263d9d,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351008cc-2f')
Apr 14 13:24:15 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Deleting instance files /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b_del
Apr 14 13:24:15 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Deletion of /opt/stack/data/nova/instances/1a866f3f-b709-4286-8cef-8e3b35f26d0b_del complete
Apr 14 13:24:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:15 user nova-compute[72019]: INFO nova.compute.manager [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 13:24:15 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23664626638303232', 'path': '/dev/sdd'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664626638303232', 'path': '/dev/sdd'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1066264697',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1066264697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1066264697',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-p5quvd2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:24:10Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=82d3b319-f069-48b6-bb53-32835bc6a2e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "address": "fa:16:3e:7e:24:9e", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5b7a99-53", "ovs_interfaceid": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "address": "fa:16:3e:7e:24:9e", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5b7a99-53", "ovs_interfaceid": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:24:9e,bridge_name='br-int',has_traffic_filtering=True,id=6f5b7a99-53da-4ad1-b18a-d4b62d359e1b,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5b7a99-53') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.objects.instance [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lazy-loading 'pci_devices' on Instance uuid 82d3b319-f069-48b6-bb53-32835bc6a2e3 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:24:16 user nova-compute[72019]:   <uuid>82d3b319-f069-48b6-bb53-32835bc6a2e3</uuid>
Apr 14 13:24:16 user nova-compute[72019]:   <name>instance-00000021</name>
Apr 14 13:24:16 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:24:16 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:24:16 user nova-compute[72019]:   <metadata>
Apr 14 13:24:16 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:24:16 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:24:16 user nova-compute[72019]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1066264697</nova:name>
Apr 14 13:24:16 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:24:14</nova:creationTime>
Apr 14 13:24:16 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:24:16 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:24:16 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:24:16 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:24:16 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:24:16 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:24:16 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:24:16 user nova-compute[72019]:       <nova:owner>
Apr 14 13:24:16 user nova-compute[72019]:         <nova:user uuid="bb40413bd0c3490d97b997f69c930f72">tempest-TestVolumeBootPattern-1645546988-project-member</nova:user>
Apr 14 13:24:16 user nova-compute[72019]:         <nova:project uuid="818de6fa330c4c87a3b6228345d9f13a">tempest-TestVolumeBootPattern-1645546988</nova:project>
Apr 14 13:24:16 user nova-compute[72019]:       </nova:owner>
Apr 14 13:24:16 user nova-compute[72019]:       <nova:ports>
Apr 14 13:24:16 user nova-compute[72019]:         <nova:port uuid="6f5b7a99-53da-4ad1-b18a-d4b62d359e1b">
Apr 14 13:24:16 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 13:24:16 user nova-compute[72019]:         </nova:port>
Apr 14 13:24:16 user nova-compute[72019]:       </nova:ports>
Apr 14 13:24:16 user nova-compute[72019]:     </nova:instance>
Apr 14 13:24:16 user nova-compute[72019]:   </metadata>
Apr 14 13:24:16 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:24:16 user nova-compute[72019]:     <system>
Apr 14 13:24:16 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:24:16 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:24:16 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:24:16 user nova-compute[72019]:       <entry name="serial">82d3b319-f069-48b6-bb53-32835bc6a2e3</entry>
Apr 14 13:24:16 user nova-compute[72019]:       <entry name="uuid">82d3b319-f069-48b6-bb53-32835bc6a2e3</entry>
Apr 14 13:24:16 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:24:16 user nova-compute[72019]:     </system>
Apr 14 13:24:16 user nova-compute[72019]:   </sysinfo>
Apr 14 13:24:16 user nova-compute[72019]:   <os>
Apr 14 13:24:16 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:24:16 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:24:16 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:24:16 user nova-compute[72019]:   </os>
Apr 14 13:24:16 user nova-compute[72019]:   <features>
Apr 14 13:24:16 user nova-compute[72019]:     <acpi/>
Apr 14 13:24:16 user nova-compute[72019]:     <apic/>
Apr 14 13:24:16 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:24:16 user nova-compute[72019]:   </features>
Apr 14 13:24:16 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:24:16 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:24:16 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:24:16 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:24:16 user nova-compute[72019]:   </clock>
Apr 14 13:24:16 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:24:16 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:24:16 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:24:16 user nova-compute[72019]:   </cpu>
Apr 14 13:24:16 user nova-compute[72019]:   <devices>
Apr 14 13:24:16 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:24:16 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:24:16 user nova-compute[72019]:       <source dev="/dev/sdd"/>
Apr 14 13:24:16 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:24:16 user nova-compute[72019]:       <serial>fa06c410-d2f3-4211-98a9-d8bae7d21b29</serial>
Apr 14 13:24:16 user nova-compute[72019]:     </disk>
Apr 14 13:24:16 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:24:16 user nova-compute[72019]:       <mac address="fa:16:3e:7e:24:9e"/>
Apr 14 13:24:16 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:24:16 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:24:16 user nova-compute[72019]:       <target dev="tap6f5b7a99-53"/>
Apr 14 13:24:16 user nova-compute[72019]:     </interface>
Apr 14 13:24:16 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:24:16 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/82d3b319-f069-48b6-bb53-32835bc6a2e3/console.log" append="off"/>
Apr 14 13:24:16 user nova-compute[72019]:     </serial>
Apr 14 13:24:16 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:24:16 user nova-compute[72019]:     <video>
Apr 14 13:24:16 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:24:16 user nova-compute[72019]:     </video>
Apr 14 13:24:16 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:24:16 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:24:16 user nova-compute[72019]:     </rng>
Apr 14 13:24:16 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:24:16 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:24:16 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:24:16 user nova-compute[72019]:     </memballoon>
Apr 14 13:24:16 user nova-compute[72019]:   </devices>
Apr 14 13:24:16 user nova-compute[72019]: </domain>
Apr 14 13:24:16 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1066264697',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1066264697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1066264697',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-p5quvd2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:24:10Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=82d3b319-f069-48b6-bb53-32835bc6a2e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "address": "fa:16:3e:7e:24:9e", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5b7a99-53", "ovs_interfaceid": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "address": "fa:16:3e:7e:24:9e", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5b7a99-53", "ovs_interfaceid": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:24:9e,bridge_name='br-int',has_traffic_filtering=True,id=6f5b7a99-53da-4ad1-b18a-d4b62d359e1b,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5b7a99-53') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG os_vif [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:24:9e,bridge_name='br-int',has_traffic_filtering=True,id=6f5b7a99-53da-4ad1-b18a-d4b62d359e1b,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5b7a99-53') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f5b7a99-53, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f5b7a99-53, col_values=(('external_ids', {'iface-id': '6f5b7a99-53da-4ad1-b18a-d4b62d359e1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:24:9e', 'vm-uuid': '82d3b319-f069-48b6-bb53-32835bc6a2e3'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:16 user nova-compute[72019]: INFO os_vif [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:24:9e,bridge_name='br-int',has_traffic_filtering=True,id=6f5b7a99-53da-4ad1-b18a-d4b62d359e1b,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5b7a99-53')
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] No VIF found with MAC fa:16:3e:7e:24:9e, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:24:16 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Took 1.15 seconds to deallocate network for instance.
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-8396df35-f292-440d-bf0e-103b36a8dfe2 req-a3519f73-54e2-44c8-a537-452d500bba27 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-vif-deleted-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:16 user nova-compute[72019]: INFO nova.compute.manager [req-8396df35-f292-440d-bf0e-103b36a8dfe2 req-a3519f73-54e2-44c8-a537-452d500bba27 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Neutron deleted interface 351008cc-2fb2-4fa8-997d-96ea40263d9d; detaching it from the instance and deleting it from the info cache
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.network.neutron [req-8396df35-f292-440d-bf0e-103b36a8dfe2 req-a3519f73-54e2-44c8-a537-452d500bba27 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-8396df35-f292-440d-bf0e-103b36a8dfe2 req-a3519f73-54e2-44c8-a537-452d500bba27 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Detach interface failed, port_id=351008cc-2fb2-4fa8-997d-96ea40263d9d, reason: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:16 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] No waiting events found dispatching network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:17 user nova-compute[72019]: WARNING nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received unexpected event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d for instance with vm_state deleted and task_state None.
Apr 14 13:24:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] No waiting events found dispatching network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:17 user nova-compute[72019]: WARNING nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received unexpected event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d for instance with vm_state deleted and task_state None.
Apr 14 13:24:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] No waiting events found dispatching network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:17 user nova-compute[72019]: WARNING nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received unexpected event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d for instance with vm_state deleted and task_state None.
Apr 14 13:24:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-vif-unplugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] No waiting events found dispatching network-vif-unplugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:17 user nova-compute[72019]: WARNING nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received unexpected event network-vif-unplugged-351008cc-2fb2-4fa8-997d-96ea40263d9d for instance with vm_state deleted and task_state None.
Apr 14 13:24:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Acquiring lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] No waiting events found dispatching network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:17 user nova-compute[72019]: WARNING nova.compute.manager [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Received unexpected event network-vif-plugged-351008cc-2fb2-4fa8-997d-96ea40263d9d for instance with vm_state deleted and task_state None.
Apr 14 13:24:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:17 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Deleted allocations for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "1a866f3f-b709-4286-8cef-8e3b35f26d0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.677s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVBKAhTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:24:17 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:24:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:24:17 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:24:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:24:17 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44f5b87-e669-4911-ad54-83d84fdedf54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:24:17 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2a00c8-c9b2-4397-8d42-b037f8b1ebfa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0] added
Apr 14 13:24:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-7c2cf4e5-f9dd-4110-943c-598afe3f5e8c req-2b13fc43-7abd-407b-9b0f-981cea19c5a1 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Received event network-vif-plugged-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c2cf4e5-f9dd-4110-943c-598afe3f5e8c req-2b13fc43-7abd-407b-9b0f-981cea19c5a1 service nova] Acquiring lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c2cf4e5-f9dd-4110-943c-598afe3f5e8c req-2b13fc43-7abd-407b-9b0f-981cea19c5a1 service nova] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c2cf4e5-f9dd-4110-943c-598afe3f5e8c req-2b13fc43-7abd-407b-9b0f-981cea19c5a1 service nova] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-7c2cf4e5-f9dd-4110-943c-598afe3f5e8c req-2b13fc43-7abd-407b-9b0f-981cea19c5a1 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] No waiting events found dispatching network-vif-plugged-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:18 user nova-compute[72019]: WARNING nova.compute.manager [req-7c2cf4e5-f9dd-4110-943c-598afe3f5e8c req-2b13fc43-7abd-407b-9b0f-981cea19c5a1 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Received unexpected event network-vif-plugged-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b for instance with vm_state building and task_state spawning.
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d8d6de-3e9e-4f5d-adb3-1bfc058c6359]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec32d93d-0fb6-477b-aede-7f13a3a11208]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVBKAhTm {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVBKAhTm" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8445e7-ed76-4283-9aaa-03c08d93971e]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rVBKAhTm'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed1b3f7-8ca2-4a9d-add9-0c83121ae235]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d129603-809c-464a-8d84-7e299e9203c7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:18 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:18 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:18 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:18 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:18 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:18 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a12c42-6d61-4d23-9003-cfba933b9ca5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260]
Apr 14 13:24:18 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260] successful.
Apr 14 13:24:18 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae06f80-f9c5-4837-9fa6-7b50b96a47bc]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[983f53cc-6403-4edc-9782-72946756919d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:18 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:18 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:18 user nova-compute[72019]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:24:18 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:18 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:18 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:18 user nova-compute[72019]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:24:18 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb846611-9a34-4af8-8d95-cd27a7538b54]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVBKAhTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:24:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23663303538396433', 'path': '/dev/sde'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:24:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663303538396433', 'path': '/dev/sde'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:24:19 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'flavor' on Instance uuid 49467859-954f-498d-b520-587c7f38effc {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:24:19 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:24:19 user nova-compute[72019]:   <source dev="/dev/sde"/>
Apr 14 13:24:19 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:24:19 user nova-compute[72019]:   <serial>fcdfe359-4681-4ebf-847d-85edfd26edc0</serial>
Apr 14 13:24:19 user nova-compute[72019]: </disk>
Apr 14 13:24:19 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:24:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:24:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:24:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] No VIF found with MAC fa:16:3e:20:60:67, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:24:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "49467859-954f-498d-b520-587c7f38effc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.062s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.compute.manager [req-870ca6a8-184f-4a19-8583-6c1b68dd437e req-8b5d11de-0b14-4c52-9c24-c7d1b2cc7d76 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Received event network-vif-plugged-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-870ca6a8-184f-4a19-8583-6c1b68dd437e req-8b5d11de-0b14-4c52-9c24-c7d1b2cc7d76 service nova] Acquiring lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-870ca6a8-184f-4a19-8583-6c1b68dd437e req-8b5d11de-0b14-4c52-9c24-c7d1b2cc7d76 service nova] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-870ca6a8-184f-4a19-8583-6c1b68dd437e req-8b5d11de-0b14-4c52-9c24-c7d1b2cc7d76 service nova] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.compute.manager [req-870ca6a8-184f-4a19-8583-6c1b68dd437e req-8b5d11de-0b14-4c52-9c24-c7d1b2cc7d76 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] No waiting events found dispatching network-vif-plugged-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:20 user nova-compute[72019]: WARNING nova.compute.manager [req-870ca6a8-184f-4a19-8583-6c1b68dd437e req-8b5d11de-0b14-4c52-9c24-c7d1b2cc7d76 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Received unexpected event network-vif-plugged-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b for instance with vm_state building and task_state spawning.
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478660.096544, 82d3b319-f069-48b6-bb53-32835bc6a2e3 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:24:20 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] VM Resumed (Lifecycle Event)
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:24:20 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Instance spawned successfully.
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:24:20 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478660.0992267, 82d3b319-f069-48b6-bb53-32835bc6a2e3 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:24:20 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] VM Started (Lifecycle Event)
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:24:20 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:24:20 user nova-compute[72019]: INFO nova.compute.manager [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Took 5.50 seconds to spawn the instance on the hypervisor.
Apr 14 13:24:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:24:20 user nova-compute[72019]: INFO nova.compute.manager [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Took 11.37 seconds to build instance.
Apr 14 13:24:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.480s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-f6995af7-43d0-4b27-9257-7e48a62af4e1 req-73e8da4b-c76e-4d99-9513-fe17d28d66a2 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-changed-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-f6995af7-43d0-4b27-9257-7e48a62af4e1 req-73e8da4b-c76e-4d99-9513-fe17d28d66a2 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Refreshing instance network info cache due to event network-changed-bcff28e3-32d8-4f26-b087-4b1082f06cfb. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:24:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f6995af7-43d0-4b27-9257-7e48a62af4e1 req-73e8da4b-c76e-4d99-9513-fe17d28d66a2 service nova] Acquiring lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:24:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f6995af7-43d0-4b27-9257-7e48a62af4e1 req-73e8da4b-c76e-4d99-9513-fe17d28d66a2 service nova] Acquired lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:24:26 user nova-compute[72019]: DEBUG nova.network.neutron [req-f6995af7-43d0-4b27-9257-7e48a62af4e1 req-73e8da4b-c76e-4d99-9513-fe17d28d66a2 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Refreshing network info cache for port bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:24:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:27 user nova-compute[72019]: DEBUG nova.network.neutron [req-f6995af7-43d0-4b27-9257-7e48a62af4e1 req-73e8da4b-c76e-4d99-9513-fe17d28d66a2 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Updated VIF entry in instance network info cache for port bcff28e3-32d8-4f26-b087-4b1082f06cfb. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:24:27 user nova-compute[72019]: DEBUG nova.network.neutron [req-f6995af7-43d0-4b27-9257-7e48a62af4e1 req-73e8da4b-c76e-4d99-9513-fe17d28d66a2 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Updating instance_info_cache with network_info: [{"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:24:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f6995af7-43d0-4b27-9257-7e48a62af4e1 req-73e8da4b-c76e-4d99-9513-fe17d28d66a2 service nova] Releasing lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:24:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-f4d674bb-669a-475e-8a92-4f91119b5c7d req-ed0dd460-23a6-46bd-8791-1c1fcdd3a38e service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-changed-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-f4d674bb-669a-475e-8a92-4f91119b5c7d req-ed0dd460-23a6-46bd-8791-1c1fcdd3a38e service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Refreshing instance network info cache due to event network-changed-bcff28e3-32d8-4f26-b087-4b1082f06cfb. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:24:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f4d674bb-669a-475e-8a92-4f91119b5c7d req-ed0dd460-23a6-46bd-8791-1c1fcdd3a38e service nova] Acquiring lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:24:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f4d674bb-669a-475e-8a92-4f91119b5c7d req-ed0dd460-23a6-46bd-8791-1c1fcdd3a38e service nova] Acquired lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:24:29 user nova-compute[72019]: DEBUG nova.network.neutron [req-f4d674bb-669a-475e-8a92-4f91119b5c7d req-ed0dd460-23a6-46bd-8791-1c1fcdd3a38e service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Refreshing network info cache for port bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:24:29 user nova-compute[72019]: DEBUG nova.network.neutron [req-f4d674bb-669a-475e-8a92-4f91119b5c7d req-ed0dd460-23a6-46bd-8791-1c1fcdd3a38e service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Updated VIF entry in instance network info cache for port bcff28e3-32d8-4f26-b087-4b1082f06cfb. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:24:29 user nova-compute[72019]: DEBUG nova.network.neutron [req-f4d674bb-669a-475e-8a92-4f91119b5c7d req-ed0dd460-23a6-46bd-8791-1c1fcdd3a38e service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Updating instance_info_cache with network_info: [{"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:24:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f4d674bb-669a-475e-8a92-4f91119b5c7d req-ed0dd460-23a6-46bd-8791-1c1fcdd3a38e service nova] Releasing lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:24:30 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478655.2869794, 1a866f3f-b709-4286-8cef-8e3b35f26d0b => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:24:30 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] VM Stopped (Lifecycle Event)
Apr 14 13:24:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-f82c4eb0-f5e5-4d20-b905-18d26680eb78 None None] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:24:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "49467859-954f-498d-b520-587c7f38effc" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "49467859-954f-498d-b520-587c7f38effc" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:32 user nova-compute[72019]: INFO nova.compute.manager [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Rebooting instance
Apr 14 13:24:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:24:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquired lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:24:32 user nova-compute[72019]: DEBUG nova.network.neutron [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG nova.network.neutron [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Updating instance_info_cache with network_info: [{"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Releasing lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Updating instance_info_cache with network_info: [{"id": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "address": "fa:16:3e:7a:a4:82", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6952bc-e5", "ovs_interfaceid": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-f93d53ee-ea67-4c82-bd38-3e6554430eae req-1dce27f0-cb8a-4202-9572-dbad26fbbca8 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-vif-unplugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f93d53ee-ea67-4c82-bd38-3e6554430eae req-1dce27f0-cb8a-4202-9572-dbad26fbbca8 service nova] Acquiring lock "49467859-954f-498d-b520-587c7f38effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f93d53ee-ea67-4c82-bd38-3e6554430eae req-1dce27f0-cb8a-4202-9572-dbad26fbbca8 service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f93d53ee-ea67-4c82-bd38-3e6554430eae req-1dce27f0-cb8a-4202-9572-dbad26fbbca8 service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-f93d53ee-ea67-4c82-bd38-3e6554430eae req-1dce27f0-cb8a-4202-9572-dbad26fbbca8 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] No waiting events found dispatching network-vif-unplugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:33 user nova-compute[72019]: WARNING nova.compute.manager [req-f93d53ee-ea67-4c82-bd38-3e6554430eae req-1dce27f0-cb8a-4202-9572-dbad26fbbca8 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received unexpected event network-vif-unplugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance with vm_state active and task_state reboot_started_hard.
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:24:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:34 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 49467859-954f-498d-b520-587c7f38effc] Instance destroyed successfully.
Apr 14 13:24:34 user nova-compute[72019]: DEBUG nova.objects.instance [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'resources' on Instance uuid 49467859-954f-498d-b520-587c7f38effc {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-672930101',display_name='tempest-TestMinimumBasicScenario-server-672930101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-672930101',id=30,image_ref='e02d2ab7-d36b-42ce-8a09-589fe97d2745',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyN7ZXz/DhnftGXoG1DqPcVc2gONInGkCMU1F9WltEW9B7MyWX6QLuMCCaRSexfOtRkN3kvfw4EU0QaJ4W82L+01s5mIUUjLtEeLBACLFDo9jDFd26Q2mqx8aDpkmAeHQ==',key_name='tempest-TestMinimumBasicScenario-1723696496',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae2e95243bc4e19b093629197fbb173',ramdisk_id='',reservation_id='r-nhxs7xka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e02d2ab7-d36b-42ce-8a09-589fe97d2745',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-929002235',owner_user_name='tempest-TestMinimumBasicScenario-929002235-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:24:33Z,user_data=None,user_id='9e1f366e5f9d43b9bbd8be316ddaa3a9',uuid=49467859-954f-498d-b520-587c7f38effc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converting VIF {"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:60:67,bridge_name='br-int',has_traffic_filtering=True,id=bcff28e3-32d8-4f26-b087-4b1082f06cfb,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcff28e3-32') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_vif [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:60:67,bridge_name='br-int',has_traffic_filtering=True,id=bcff28e3-32d8-4f26-b087-4b1082f06cfb,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcff28e3-32') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcff28e3-32, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:24:34 user nova-compute[72019]: INFO os_vif [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:60:67,bridge_name='br-int',has_traffic_filtering=True,id=bcff28e3-32d8-4f26-b087-4b1082f06cfb,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcff28e3-32')
Apr 14 13:24:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVBKAhTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:24:34 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd799c76-57a5-4ca4-a47b-a28f4153f54d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:24:34 user nova-compute[72019]: No targets found.
Apr 14 13:24:34 user nova-compute[72019]: iSNS:
Apr 14 13:24:34 user nova-compute[72019]: No targets found.
Apr 14 13:24:34 user nova-compute[72019]: STATIC:
Apr 14 13:24:34 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc
Apr 14 13:24:34 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:24:34 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:24:34 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0
Apr 14 13:24:34 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:24:34 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:24:34 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:24:34 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:24:34 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:24:34 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29
Apr 14 13:24:34 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:24:34 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:24:34 user nova-compute[72019]: FIRMWARE:
Apr 14 13:24:34 user nova-compute[72019]: No targets found.
Apr 14 13:24:34 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:24:34 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:24:34 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.046s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d4c5a3-4227-45fe-b948-bcc2f571c0d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa73148-c86c-4a4e-8ddd-68de0c976eec]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:34 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:34 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:34 user nova-compute[72019]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:24:34 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:34 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:34 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:34 user nova-compute[72019]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:24:34 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74900f2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0'): ({'sde'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Removing single pathed devices sde {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[472a8e5e-56c1-454b-b36d-728d3d3a1303]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd154161-a507-4979-90f2-8a2cecc5ddde]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Flushing IO for device /dev/sde {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[06896e60-b80e-47cf-8394-88bd7906fd0f]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[217ad931-9f64-4310-bd6d-e377cdca0028]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[502f5305-81b3-4e98-bfb9-d9bbb1606527]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1503054c-b9b8-4118-8b73-3241683447b8]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260]
Apr 14 13:24:34 user nova-compute[72019]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260] successful.
Apr 14 13:24:34 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4dd619-f0df-4fb8-8872-cb1499a5fb5a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.544s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] <== disconnect_volume: return (548ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Start _get_guest_xml network_info=[{"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e02d2ab7-d36b-42ce-8a09-589fe97d2745,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': 'e02d2ab7-d36b-42ce-8a09-589fe97d2745'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '3e3f3764-37f9-4b6a-bc6b-37858f530c43', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVBKAhTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '49467859-954f-498d-b520-587c7f38effc', 'attached_at': '', 'detached_at': '', 'volume_id': 'fcdfe359-4681-4ebf-847d-85edfd26edc0', 'serial': 'fcdfe359-4681-4ebf-847d-85edfd26edc0'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:24:35 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:24:35 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e02d2ab7-d36b-42ce-8a09-589fe97d2745,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.objects.instance [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'vcpu_model' on Instance uuid 49467859-954f-498d-b520-587c7f38effc {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVBKAhTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:24:35 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:24:35 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:24:35 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3890ab2-5c56-4d82-9a9e-ad4c6e868468]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:24:35 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[558641b3-81a3-41c7-9372-17bb3451e6a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0] added
Apr 14 13:24:35 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b665fa70-6480-412b-a510-fe51778d5245]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d871aaa-09bc-4131-bbe0-3fc5f6119b20]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVBKAhTm {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVBKAhTm" returned: 0 in 0.042s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[712e67ce-477b-40ee-9b2d-bb547bbe4000]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rVBKAhTm'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b603564-71eb-4096-9cfe-d55e63bf5eda]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e46d48-4c10-48c8-8d2c-f953234bd903]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:35 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:35 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:35 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:35 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:35 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:35 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfda0751-a914-400a-b0ae-6cc7899d4cc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260]
Apr 14 13:24:35 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260] successful.
Apr 14 13:24:35 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc56e14d-42c6-4efc-958c-95e97f91f8f9]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a275645-d3a3-4a87-a0ac-9c90d1dd25d9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:35 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:35 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:35 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:24:35 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:35 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:35 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:35 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:24:35 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.536s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded49276-7a62-4b1d-88a3-3fdbf9fba35a]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: None {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Acquiring lock "49467859-954f-498d-b520-587c7f38effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] No waiting events found dispatching network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:36 user nova-compute[72019]: WARNING nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received unexpected event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance with vm_state active and task_state reboot_started_hard.
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Acquiring lock "49467859-954f-498d-b520-587c7f38effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] No waiting events found dispatching network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:36 user nova-compute[72019]: WARNING nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received unexpected event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance with vm_state active and task_state reboot_started_hard.
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Acquiring lock "49467859-954f-498d-b520-587c7f38effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] No waiting events found dispatching network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:36 user nova-compute[72019]: WARNING nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received unexpected event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance with vm_state active and task_state reboot_started_hard.
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-vif-unplugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Acquiring lock "49467859-954f-498d-b520-587c7f38effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] No waiting events found dispatching network-vif-unplugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:36 user nova-compute[72019]: WARNING nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received unexpected event network-vif-unplugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance with vm_state active and task_state reboot_started_hard.
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Acquiring lock "49467859-954f-498d-b520-587c7f38effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] No waiting events found dispatching network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:36 user nova-compute[72019]: WARNING nova.compute.manager [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received unexpected event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance with vm_state active and task_state reboot_started_hard.
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:36 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Error from libvirt while getting description of instance-0000001e: [Error Code 42] Domain not found: no domain with matching uuid '49467859-954f-498d-b520-587c7f38effc' (instance-0000001e): libvirt.libvirtError: Domain not found: no domain with matching uuid '49467859-954f-498d-b520-587c7f38effc' (instance-0000001e)
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVBKAhTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.585s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] <== connect_volume: return (1587ms) {'type': 'block', 'scsi_wwn': '23663303538396433', 'path': '/dev/sde'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663303538396433', 'path': '/dev/sde'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-672930101',display_name='tempest-TestMinimumBasicScenario-server-672930101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-672930101',id=30,image_ref='e02d2ab7-d36b-42ce-8a09-589fe97d2745',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyN7ZXz/DhnftGXoG1DqPcVc2gONInGkCMU1F9WltEW9B7MyWX6QLuMCCaRSexfOtRkN3kvfw4EU0QaJ4W82L+01s5mIUUjLtEeLBACLFDo9jDFd26Q2mqx8aDpkmAeHQ==',key_name='tempest-TestMinimumBasicScenario-1723696496',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae2e95243bc4e19b093629197fbb173',ramdisk_id='',reservation_id='r-nhxs7xka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e02d2ab7-d36b-42ce-8a09-589fe97d2745',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-929002235',owner_user_name='tempest-TestMinimumBasicScenario-929002235-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:24:33Z,user_data=None,user_id='9e1f366e5f9d43b9bbd8be316ddaa3a9',uuid=49467859-954f-498d-b520-587c7f38effc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converting VIF {"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:60:67,bridge_name='br-int',has_traffic_filtering=True,id=bcff28e3-32d8-4f26-b087-4b1082f06cfb,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcff28e3-32') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.objects.instance [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'pci_devices' on Instance uuid 49467859-954f-498d-b520-587c7f38effc {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:24:36 user nova-compute[72019]:   <uuid>49467859-954f-498d-b520-587c7f38effc</uuid>
Apr 14 13:24:36 user nova-compute[72019]:   <name>instance-0000001e</name>
Apr 14 13:24:36 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:24:36 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:24:36 user nova-compute[72019]:   <metadata>
Apr 14 13:24:36 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:24:36 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:24:36 user nova-compute[72019]:       <nova:name>tempest-TestMinimumBasicScenario-server-672930101</nova:name>
Apr 14 13:24:36 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:24:35</nova:creationTime>
Apr 14 13:24:36 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:24:36 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:24:36 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:24:36 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:24:36 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:24:36 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:24:36 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:24:36 user nova-compute[72019]:       <nova:owner>
Apr 14 13:24:36 user nova-compute[72019]:         <nova:user uuid="9e1f366e5f9d43b9bbd8be316ddaa3a9">tempest-TestMinimumBasicScenario-929002235-project-member</nova:user>
Apr 14 13:24:36 user nova-compute[72019]:         <nova:project uuid="9ae2e95243bc4e19b093629197fbb173">tempest-TestMinimumBasicScenario-929002235</nova:project>
Apr 14 13:24:36 user nova-compute[72019]:       </nova:owner>
Apr 14 13:24:36 user nova-compute[72019]:       <nova:root type="image" uuid="e02d2ab7-d36b-42ce-8a09-589fe97d2745"/>
Apr 14 13:24:36 user nova-compute[72019]:       <nova:ports>
Apr 14 13:24:36 user nova-compute[72019]:         <nova:port uuid="bcff28e3-32d8-4f26-b087-4b1082f06cfb">
Apr 14 13:24:36 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 13:24:36 user nova-compute[72019]:         </nova:port>
Apr 14 13:24:36 user nova-compute[72019]:       </nova:ports>
Apr 14 13:24:36 user nova-compute[72019]:     </nova:instance>
Apr 14 13:24:36 user nova-compute[72019]:   </metadata>
Apr 14 13:24:36 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:24:36 user nova-compute[72019]:     <system>
Apr 14 13:24:36 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:24:36 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:24:36 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:24:36 user nova-compute[72019]:       <entry name="serial">49467859-954f-498d-b520-587c7f38effc</entry>
Apr 14 13:24:36 user nova-compute[72019]:       <entry name="uuid">49467859-954f-498d-b520-587c7f38effc</entry>
Apr 14 13:24:36 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:24:36 user nova-compute[72019]:     </system>
Apr 14 13:24:36 user nova-compute[72019]:   </sysinfo>
Apr 14 13:24:36 user nova-compute[72019]:   <os>
Apr 14 13:24:36 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:24:36 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:24:36 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:24:36 user nova-compute[72019]:   </os>
Apr 14 13:24:36 user nova-compute[72019]:   <features>
Apr 14 13:24:36 user nova-compute[72019]:     <acpi/>
Apr 14 13:24:36 user nova-compute[72019]:     <apic/>
Apr 14 13:24:36 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:24:36 user nova-compute[72019]:   </features>
Apr 14 13:24:36 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:24:36 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:24:36 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:24:36 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:24:36 user nova-compute[72019]:   </clock>
Apr 14 13:24:36 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:24:36 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:24:36 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:24:36 user nova-compute[72019]:   </cpu>
Apr 14 13:24:36 user nova-compute[72019]:   <devices>
Apr 14 13:24:36 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:24:36 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:24:36 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk"/>
Apr 14 13:24:36 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:24:36 user nova-compute[72019]:     </disk>
Apr 14 13:24:36 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:24:36 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:24:36 user nova-compute[72019]:       <source dev="/dev/sde"/>
Apr 14 13:24:36 user nova-compute[72019]:       <target dev="vdb" bus="virtio"/>
Apr 14 13:24:36 user nova-compute[72019]:       <serial>fcdfe359-4681-4ebf-847d-85edfd26edc0</serial>
Apr 14 13:24:36 user nova-compute[72019]:     </disk>
Apr 14 13:24:36 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:24:36 user nova-compute[72019]:       <mac address="fa:16:3e:20:60:67"/>
Apr 14 13:24:36 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:24:36 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:24:36 user nova-compute[72019]:       <target dev="tapbcff28e3-32"/>
Apr 14 13:24:36 user nova-compute[72019]:     </interface>
Apr 14 13:24:36 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:24:36 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/console.log" append="off"/>
Apr 14 13:24:36 user nova-compute[72019]:     </serial>
Apr 14 13:24:36 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:24:36 user nova-compute[72019]:     <video>
Apr 14 13:24:36 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:24:36 user nova-compute[72019]:     </video>
Apr 14 13:24:36 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:24:36 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:24:36 user nova-compute[72019]:     </rng>
Apr 14 13:24:36 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:24:36 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:24:36 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:24:36 user nova-compute[72019]:     </memballoon>
Apr 14 13:24:36 user nova-compute[72019]:   </devices>
Apr 14 13:24:36 user nova-compute[72019]: </domain>
Apr 14 13:24:36 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG nova.objects.instance [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'trusted_certs' on Instance uuid 49467859-954f-498d-b520-587c7f38effc {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32352c08c2d4f8c1c8764357c91f019a97457fcf --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Cannot resize image /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG nova.objects.instance [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'migration_context' on Instance uuid 49467859-954f-498d-b520-587c7f38effc {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-672930101',display_name='tempest-TestMinimumBasicScenario-server-672930101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-672930101',id=30,image_ref='e02d2ab7-d36b-42ce-8a09-589fe97d2745',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyN7ZXz/DhnftGXoG1DqPcVc2gONInGkCMU1F9WltEW9B7MyWX6QLuMCCaRSexfOtRkN3kvfw4EU0QaJ4W82L+01s5mIUUjLtEeLBACLFDo9jDFd26Q2mqx8aDpkmAeHQ==',key_name='tempest-TestMinimumBasicScenario-1723696496',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='9ae2e95243bc4e19b093629197fbb173',ramdisk_id='',reservation_id='r-nhxs7xka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e02d2ab7-d36b-42ce-8a09-589fe97d2745',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-929002235',owner_user_name='tempest-TestMinimumBasicScenario-929002235-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:24:33Z,user_data=None,user_id='9e1f366e5f9d43b9bbd8be316ddaa3a9',uuid=49467859-954f-498d-b520-587c7f38effc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converting VIF {"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:60:67,bridge_name='br-int',has_traffic_filtering=True,id=bcff28e3-32d8-4f26-b087-4b1082f06cfb,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcff28e3-32') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG os_vif [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:60:67,bridge_name='br-int',has_traffic_filtering=True,id=bcff28e3-32d8-4f26-b087-4b1082f06cfb,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcff28e3-32') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcff28e3-32, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbcff28e3-32, col_values=(('external_ids', {'iface-id': 'bcff28e3-32d8-4f26-b087-4b1082f06cfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:60:67', 'vm-uuid': '49467859-954f-498d-b520-587c7f38effc'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:37 user nova-compute[72019]: INFO os_vif [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:60:67,bridge_name='br-int',has_traffic_filtering=True,id=bcff28e3-32d8-4f26-b087-4b1082f06cfb,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcff28e3-32')
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-b5f94e36-03c0-4373-a702-e468949078a4 req-86172db2-3909-4d1e-bc22-28c47cdf22be service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b5f94e36-03c0-4373-a702-e468949078a4 req-86172db2-3909-4d1e-bc22-28c47cdf22be service nova] Acquiring lock "49467859-954f-498d-b520-587c7f38effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b5f94e36-03c0-4373-a702-e468949078a4 req-86172db2-3909-4d1e-bc22-28c47cdf22be service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b5f94e36-03c0-4373-a702-e468949078a4 req-86172db2-3909-4d1e-bc22-28c47cdf22be service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-b5f94e36-03c0-4373-a702-e468949078a4 req-86172db2-3909-4d1e-bc22-28c47cdf22be service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] No waiting events found dispatching network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:41 user nova-compute[72019]: WARNING nova.compute.manager [req-b5f94e36-03c0-4373-a702-e468949078a4 req-86172db2-3909-4d1e-bc22-28c47cdf22be service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received unexpected event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance with vm_state active and task_state reboot_started_hard.
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-63b3843d-ed80-4b0f-b73e-8396b33521c8 req-75dd715b-5109-49af-abb2-39a89d270027 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-63b3843d-ed80-4b0f-b73e-8396b33521c8 req-75dd715b-5109-49af-abb2-39a89d270027 service nova] Acquiring lock "49467859-954f-498d-b520-587c7f38effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-63b3843d-ed80-4b0f-b73e-8396b33521c8 req-75dd715b-5109-49af-abb2-39a89d270027 service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-63b3843d-ed80-4b0f-b73e-8396b33521c8 req-75dd715b-5109-49af-abb2-39a89d270027 service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-63b3843d-ed80-4b0f-b73e-8396b33521c8 req-75dd715b-5109-49af-abb2-39a89d270027 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] No waiting events found dispatching network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:41 user nova-compute[72019]: WARNING nova.compute.manager [req-63b3843d-ed80-4b0f-b73e-8396b33521c8 req-75dd715b-5109-49af-abb2-39a89d270027 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received unexpected event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance with vm_state active and task_state reboot_started_hard.
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for 49467859-954f-498d-b520-587c7f38effc due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478681.0339003, 49467859-954f-498d-b520-587c7f38effc => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:24:41 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] VM Resumed (Lifecycle Event)
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:24:41 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 49467859-954f-498d-b520-587c7f38effc] Instance rebooted successfully.
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:24:41 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:24:41 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7669MB free_disk=26.101848602294922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:24:41 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478681.034482, 49467859-954f-498d-b520-587c7f38effc => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:24:41 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] VM Started (Lifecycle Event)
Apr 14 13:24:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "49467859-954f-498d-b520-587c7f38effc" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.513s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 775293fc-1773-407d-bf49-fccfe849f440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 49467859-954f-498d-b520-587c7f38effc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 01f10bee-45ba-4541-8af8-e392018ef468 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:24:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-1792110f-a659-4bd9-913d-6fd89d122b26 req-c2751eb3-5795-4c48-99d1-6e2a0938745e service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Received event network-changed-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-1792110f-a659-4bd9-913d-6fd89d122b26 req-c2751eb3-5795-4c48-99d1-6e2a0938745e service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Refreshing instance network info cache due to event network-changed-0a44c0e9-c717-4924-b996-4f0db4d1c1a3. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:24:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1792110f-a659-4bd9-913d-6fd89d122b26 req-c2751eb3-5795-4c48-99d1-6e2a0938745e service nova] Acquiring lock "refresh_cache-ed09e4b4-dd5f-4200-be08-7260da0c7d85" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:24:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1792110f-a659-4bd9-913d-6fd89d122b26 req-c2751eb3-5795-4c48-99d1-6e2a0938745e service nova] Acquired lock "refresh_cache-ed09e4b4-dd5f-4200-be08-7260da0c7d85" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:24:43 user nova-compute[72019]: DEBUG nova.network.neutron [req-1792110f-a659-4bd9-913d-6fd89d122b26 req-c2751eb3-5795-4c48-99d1-6e2a0938745e service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Refreshing network info cache for port 0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:24:43 user nova-compute[72019]: DEBUG nova.network.neutron [req-1792110f-a659-4bd9-913d-6fd89d122b26 req-c2751eb3-5795-4c48-99d1-6e2a0938745e service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Updated VIF entry in instance network info cache for port 0a44c0e9-c717-4924-b996-4f0db4d1c1a3. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:24:43 user nova-compute[72019]: DEBUG nova.network.neutron [req-1792110f-a659-4bd9-913d-6fd89d122b26 req-c2751eb3-5795-4c48-99d1-6e2a0938745e service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Updating instance_info_cache with network_info: [{"id": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "address": "fa:16:3e:66:c1:bf", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a44c0e9-c7", "ovs_interfaceid": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:24:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1792110f-a659-4bd9-913d-6fd89d122b26 req-c2751eb3-5795-4c48-99d1-6e2a0938745e service nova] Releasing lock "refresh_cache-ed09e4b4-dd5f-4200-be08-7260da0c7d85" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG nova.objects.instance [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'flavor' on Instance uuid ed09e4b4-dd5f-4200-be08-7260da0c7d85 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:45 user nova-compute[72019]: INFO nova.compute.manager [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Attaching volume 31003792-6da3-45f1-9abb-32d6dd53dc98 to /dev/vdb
Apr 14 13:24:45 user nova-compute[72019]: DEBUG os_brick.utils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0df796b-9942-4e64-ba3c-4208fd135e77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b61400b-1983-4482-8d81-6375b06e73ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[043dfe62-584c-44d6-8e60-18a3888ae032]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[23974efa-99c6-4672-adde-3a818cbae38c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:24:45 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:24:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52b4a19-afa0-4649-ab5e-9348a3623d69]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG os_brick.utils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:24:45 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Updating existing volume attachment record: 4b74dd91-72ee-4439-89ed-0bd93ea2136f {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:24:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbtQAhPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:24:50 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:24:50 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:24:50 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98a0d5d-22d8-4d03-8511-e94f357d2c77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:24:50 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef5166d-2298-44e0-8254-7dd69d136bd9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98] added
Apr 14 13:24:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[742f0845-883a-43c1-a64f-3c977bf2fa05]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfe00c6-cfe8-4596-9108-4052ab74a01c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbtQAhPe {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbtQAhPe" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b23cd1-b91e-476d-bd97-3b7e06ce4418]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UbtQAhPe'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[283d7dcf-ba7b-4729-93eb-b2bd11c32d39]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe733fc-7a3e-4585-b95c-59aba8265d5c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:50 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:50 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:50 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:24:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:50 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:50 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:50 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:24:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[add02e2c-5a49-4f32-9979-2dd6b7bd514e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98, portal: 172.16.0.220,3260]
Apr 14 13:24:50 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98, portal: 172.16.0.220,3260] successful.
Apr 14 13:24:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[342de3ab-30a5-4679-bebe-5f179c29eae7]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[061ede7b-d584-4953-b8ab-5888c5e20971]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:50 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:50 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:50 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:24:50 user nova-compute[72019]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)
Apr 14 13:24:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:24:50 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:24:50 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:24:50 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:24:50 user nova-compute[72019]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)
Apr 14 13:24:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c61201-c197-452e-9b6c-fa4985937cc3]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:24:51 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:24:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbtQAhPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:24:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:24:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26334646132356631', 'path': '/dev/sdf'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:24:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334646132356631', 'path': '/dev/sdf'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:24:51 user nova-compute[72019]: DEBUG nova.objects.instance [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'flavor' on Instance uuid ed09e4b4-dd5f-4200-be08-7260da0c7d85 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:24:51 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:24:51 user nova-compute[72019]:   <source dev="/dev/sdf"/>
Apr 14 13:24:51 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:24:51 user nova-compute[72019]:   <serial>31003792-6da3-45f1-9abb-32d6dd53dc98</serial>
Apr 14 13:24:51 user nova-compute[72019]: </disk>
Apr 14 13:24:51 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:24:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:24:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:24:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] No VIF found with MAC fa:16:3e:66:c1:bf, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:24:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.968s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:55 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'flavor' on Instance uuid ed09e4b4-dd5f-4200-be08-7260da0c7d85 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-71cf4a7f-5491-4f19-bb18-045bfd33292a req-738ad0fa-e311-4ef1-808f-9fed2cfc6965 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Received event network-changed-45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-71cf4a7f-5491-4f19-bb18-045bfd33292a req-738ad0fa-e311-4ef1-808f-9fed2cfc6965 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Refreshing instance network info cache due to event network-changed-45024c25-a182-4df9-bec0-ab8dc8354659. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71cf4a7f-5491-4f19-bb18-045bfd33292a req-738ad0fa-e311-4ef1-808f-9fed2cfc6965 service nova] Acquiring lock "refresh_cache-01f10bee-45ba-4541-8af8-e392018ef468" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71cf4a7f-5491-4f19-bb18-045bfd33292a req-738ad0fa-e311-4ef1-808f-9fed2cfc6965 service nova] Acquired lock "refresh_cache-01f10bee-45ba-4541-8af8-e392018ef468" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG nova.network.neutron [req-71cf4a7f-5491-4f19-bb18-045bfd33292a req-738ad0fa-e311-4ef1-808f-9fed2cfc6965 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Refreshing network info cache for port 45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:56 user nova-compute[72019]: INFO nova.compute.manager [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Attaching volume a20ffa11-b01c-45cc-8a71-f534c44f8568 to /dev/vdc
Apr 14 13:24:56 user nova-compute[72019]: DEBUG os_brick.utils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[40befafb-a6da-4ab4-9a64-9787f7bcdf1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bfc2b9-2d08-43d0-a33c-1b55fe3698d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78987fc-bbad-48b7-bbf5-0ad293b913e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2db0183-526d-4092-98f4-48f1d92c381b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:24:56 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[172dff4e-962c-40ff-a87c-52f6f1d77f94]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG os_brick.utils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Updating existing volume attachment record: 38c30cad-ad45-4b50-9ce3-ee4da66dca9a {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG nova.network.neutron [req-71cf4a7f-5491-4f19-bb18-045bfd33292a req-738ad0fa-e311-4ef1-808f-9fed2cfc6965 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Updated VIF entry in instance network info cache for port 45024c25-a182-4df9-bec0-ab8dc8354659. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG nova.network.neutron [req-71cf4a7f-5491-4f19-bb18-045bfd33292a req-738ad0fa-e311-4ef1-808f-9fed2cfc6965 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Updating instance_info_cache with network_info: [{"id": "45024c25-a182-4df9-bec0-ab8dc8354659", "address": "fa:16:3e:35:6e:44", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45024c25-a1", "ovs_interfaceid": "45024c25-a182-4df9-bec0-ab8dc8354659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:24:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-71cf4a7f-5491-4f19-bb18-045bfd33292a req-738ad0fa-e311-4ef1-808f-9fed2cfc6965 service nova] Releasing lock "refresh_cache-01f10bee-45ba-4541-8af8-e392018ef468" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:24:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:57 user nova-compute[72019]: INFO nova.compute.manager [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Unrescuing
Apr 14 13:24:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:24:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquired lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:24:57 user nova-compute[72019]: DEBUG nova.network.neutron [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:24:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:57 user nova-compute[72019]: DEBUG nova.network.neutron [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Updating instance_info_cache with network_info: [{"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:24:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Releasing lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:24:57 user nova-compute[72019]: DEBUG nova.objects.instance [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'flavor' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:24:58 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Instance destroyed successfully.
Apr 14 13:24:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "01f10bee-45ba-4541-8af8-e392018ef468" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "01f10bee-45ba-4541-8af8-e392018ef468" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:58 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'flavor' on Instance uuid 01f10bee-45ba-4541-8af8-e392018ef468 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:24:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "01f10bee-45ba-4541-8af8-e392018ef468" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:58 user nova-compute[72019]: DEBUG nova.compute.manager [req-1ad41a9b-9a88-4299-96fe-f34452f24e03 req-3e2075d9-904b-4ac9-a91b-2b10f737085d service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-vif-unplugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:24:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1ad41a9b-9a88-4299-96fe-f34452f24e03 req-3e2075d9-904b-4ac9-a91b-2b10f737085d service nova] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1ad41a9b-9a88-4299-96fe-f34452f24e03 req-3e2075d9-904b-4ac9-a91b-2b10f737085d service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1ad41a9b-9a88-4299-96fe-f34452f24e03 req-3e2075d9-904b-4ac9-a91b-2b10f737085d service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:24:58 user nova-compute[72019]: DEBUG nova.compute.manager [req-1ad41a9b-9a88-4299-96fe-f34452f24e03 req-3e2075d9-904b-4ac9-a91b-2b10f737085d service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] No waiting events found dispatching network-vif-unplugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:24:58 user nova-compute[72019]: WARNING nova.compute.manager [req-1ad41a9b-9a88-4299-96fe-f34452f24e03 req-3e2075d9-904b-4ac9-a91b-2b10f737085d service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received unexpected event network-vif-unplugged-aef4cd67-4e33-4456-b7d9-195955db1cdc for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "01f10bee-45ba-4541-8af8-e392018ef468" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "01f10bee-45ba-4541-8af8-e392018ef468" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:24:59 user nova-compute[72019]: INFO nova.compute.manager [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Attaching volume f89394ef-17be-4375-8971-c9fa45166bee to /dev/vdb
Apr 14 13:24:59 user nova-compute[72019]: DEBUG os_brick.utils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[62759dfa-9c4e-487e-8dfe-6a71f343527a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea0863d-59c9-4966-abaf-2613cc05e615]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b1a9b0-9ea9-446d-8305-37a584732c1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5526e32a-dd7e-442a-abc6-0f281a8f8d5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:24:59 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:24:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a41749c-eaca-4135-92f9-f56178827aae]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG os_brick.utils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:24:59 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Updating existing volume attachment record: 5b59b20a-3643-4888-88a0-5a2f11ab6925 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] No waiting events found dispatching network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:25:00 user nova-compute[72019]: WARNING nova.compute.manager [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received unexpected event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:25:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] No waiting events found dispatching network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:25:00 user nova-compute[72019]: WARNING nova.compute.manager [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received unexpected event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:25:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] No waiting events found dispatching network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:25:00 user nova-compute[72019]: WARNING nova.compute.manager [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received unexpected event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:25:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxJMterD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:25:01 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:25:01 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:25:01 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[837eeb3e-38ac-4809-877b-527b1b31cfdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:25:01 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e6f5b9-ec58-4daa-ae15-d469cf580238]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568] added
Apr 14 13:25:01 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf2d8a5-5dae-4ebe-a40b-eadfcf82b2b6]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4834be5-116e-435d-8539-d3152f7b6e99]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NxJMterD {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NxJMterD" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fdbbea-081f-40e2-ace0-ef1130ddd963]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NxJMterD'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[360cbdcc-7dea-435b-a55b-20b955ba25e9]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d72221f-fdda-4729-a364-18589d77acf6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f983b99-4e6b-43e6-9d7f-e52238b27e37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568, portal: 172.16.0.220,3260]
Apr 14 13:25:01 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568, portal: 172.16.0.220,3260] successful.
Apr 14 13:25:01 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[de492beb-d606-4a0e-971f-16b41ee8d3ce]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc436d7-8281-41c2-9fbd-e14529dab8c7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)
Apr 14 13:25:01 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] HCTL ('39', '-', '-', 0) found on session 34 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.030s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e988edc-c8fe-4f60-8f8e-ddad051e5228]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Searching for a device in session 34 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:25:01 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxJMterD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:25:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:02 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:25:02 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23365316339306561', 'path': '/dev/sdh'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:25:02 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365316339306561', 'path': '/dev/sdh'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:25:02 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'flavor' on Instance uuid ed09e4b4-dd5f-4200-be08-7260da0c7d85 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:25:02 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for 775293fc-1773-407d-bf49-fccfe849f440 due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:25:02 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478702.6663506, 775293fc-1773-407d-bf49-fccfe849f440 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:25:02 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] VM Resumed (Lifecycle Event)
Apr 14 13:25:02 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:25:02 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:25:02 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:25:02 user nova-compute[72019]:   <source dev="/dev/sdh"/>
Apr 14 13:25:02 user nova-compute[72019]:   <target dev="vdc" bus="virtio"/>
Apr 14 13:25:02 user nova-compute[72019]:   <serial>a20ffa11-b01c-45cc-8a71-f534c44f8568</serial>
Apr 14 13:25:02 user nova-compute[72019]: </disk>
Apr 14 13:25:02 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:25:02 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:25:02 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:25:02 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 13:25:02 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478702.6678674, 775293fc-1773-407d-bf49-fccfe849f440 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:25:02 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] VM Started (Lifecycle Event)
Apr 14 13:25:02 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:25:02 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:25:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:25:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:25:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:25:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] No VIF found with MAC fa:16:3e:66:c1:bf, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:25:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.161s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:04 user nova-compute[72019]: INFO nova.compute.manager [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Detaching volume 31003792-6da3-45f1-9abb-32d6dd53dc98
Apr 14 13:25:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNXbznay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:25:04 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:25:04 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:25:04 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:04 user nova-compute[72019]: INFO nova.virt.block_device [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Attempting to driver detach volume 31003792-6da3-45f1-9abb-32d6dd53dc98 from mountpoint /dev/vdb
Apr 14 13:25:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Attempting to detach device vdb from instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:25:04 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:25:04 user nova-compute[72019]:   <source dev="/dev/sdf"/>
Apr 14 13:25:04 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:25:04 user nova-compute[72019]:   <serial>31003792-6da3-45f1-9abb-32d6dd53dc98</serial>
Apr 14 13:25:04 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:25:04 user nova-compute[72019]: </disk>
Apr 14 13:25:04 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e8e4c1-287c-476e-8415-ba05896253ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:25:04 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:04 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Successfully detached device vdb from instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 from the persistent domain config.
Apr 14 13:25:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:25:04 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:25:04 user nova-compute[72019]:   <source dev="/dev/sdf"/>
Apr 14 13:25:04 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:25:04 user nova-compute[72019]:   <serial>31003792-6da3-45f1-9abb-32d6dd53dc98</serial>
Apr 14 13:25:04 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:25:04 user nova-compute[72019]: </disk>
Apr 14 13:25:04 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb2f2d0-bb17-44c7-8bfd-2ff30c605a67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee] added
Apr 14 13:25:04 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d368d84-5d29-43d3-8b76-03022c93ea22]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1da618-01f7-4acf-ae2e-12824e33981f]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RNXbznay {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RNXbznay" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e07e3ba-2874-4bce-a8b3-962fe1b11dd2]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RNXbznay'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e40098-88bc-4955-9733-ca4dec3216b6]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fdf3bd-0bf0-40bd-a6eb-01c88df6c1ca]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f8e7ca-7347-486b-94ed-c0afce027450]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee, portal: 172.16.0.220,3260]
Apr 14 13:25:04 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee, portal: 172.16.0.220,3260] successful.
Apr 14 13:25:04 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03e23fb-71dd-4eb9-a294-58deb674e9ae]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa938d0-2882-4ce8-b04f-0168564758fc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee (non-flash)
Apr 14 13:25:04 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)
Apr 14 13:25:04 user nova-compute[72019]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee (non-flash)
Apr 14 13:25:04 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HCTL ('40', '-', '-', 0) found on session 35 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62b924c-59fa-4638-a443-104d57dd3795]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Searching for a device in session 35 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNXbznay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478704.7761035, ed09e4b4-dd5f-4200-be08-7260da0c7d85 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:25:04 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Successfully detached device vdb from instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 from the live domain config.
Apr 14 13:25:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbtQAhPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:25:04 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:25:04 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23763633761623664', 'path': '/dev/sdi'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763633761623664', 'path': '/dev/sdi'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.879s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'flavor' on Instance uuid 01f10bee-45ba-4541-8af8-e392018ef468 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:25:05 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:25:05 user nova-compute[72019]:   <source dev="/dev/sdi"/>
Apr 14 13:25:05 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:25:05 user nova-compute[72019]:   <serial>f89394ef-17be-4375-8971-c9fa45166bee</serial>
Apr 14 13:25:05 user nova-compute[72019]: </disk>
Apr 14 13:25:05 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.045s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[81090368-3477-4c7a-93a4-72038415cf50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:25:05 user nova-compute[72019]: No targets found.
Apr 14 13:25:05 user nova-compute[72019]: iSNS:
Apr 14 13:25:05 user nova-compute[72019]: No targets found.
Apr 14 13:25:05 user nova-compute[72019]: STATIC:
Apr 14 13:25:05 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98
Apr 14 13:25:05 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:05 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:05 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc
Apr 14 13:25:05 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:05 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:05 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0
Apr 14 13:25:05 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:05 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:05 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25
Apr 14 13:25:05 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:05 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:05 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:25:05 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:05 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:05 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568
Apr 14 13:25:05 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:05 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:05 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee
Apr 14 13:25:05 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:05 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:05 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29
Apr 14 13:25:05 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:05 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:05 user nova-compute[72019]: FIRMWARE:
Apr 14 13:25:05 user nova-compute[72019]: No targets found.
Apr 14 13:25:05 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:25:05 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:25:05 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[730921c8-c890-4a20-bd3c-e1094e6afa7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5111bc0-bb3c-4632-95cc-b59dbe5c3cb3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:25:05 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:25:05 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:25:05 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:25:05 user nova-compute[72019]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)
Apr 14 13:25:05 user nova-compute[72019]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)
Apr 14 13:25:05 user nova-compute[72019]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)
Apr 14 13:25:05 user nova-compute[72019]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee (non-flash)
Apr 14 13:25:05 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:25:05 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:25:05 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:25:05 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:25:05 user nova-compute[72019]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 (non-flash)
Apr 14 13:25:05 user nova-compute[72019]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32e6fe26-73a8-4866-8dd3-ce3d91adcf25 (non-flash)
Apr 14 13:25:05 user nova-compute[72019]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)
Apr 14 13:25:05 user nova-compute[72019]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee (non-flash)
Apr 14 13:25:05 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f749aa1cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98'): ({'sdf'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Removing single pathed devices sdf {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5006dbfd-5e20-414f-9ba0-f4a80ef0a188]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[225bfd41-94b1-4a99-ba4e-e9eef6f0de7b]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flushing IO for device /dev/sdf {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16b9c08-4cee-4c14-bcf5-4a166c87623c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f24faff-dac5-491d-a815-20e9632a9fa6]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] SCSI volumes sdf have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5741264-f22b-4826-8568-dd8de37fa47d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9c188c-56fd-4382-8330-6f310f8598a2]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98, portal: 172.16.0.220,3260]
Apr 14 13:25:06 user nova-compute[72019]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98, portal: 172.16.0.220,3260] successful.
Apr 14 13:25:06 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31003792-6da3-45f1-9abb-32d6dd53dc98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[77115960-4407-4b9f-98ab-c3197fb10a03]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:25:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] <== disconnect_volume: return (1324ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:25:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:25:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:25:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:25:06 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] No VIF found with MAC fa:16:3e:35:6e:44, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:25:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "01f10bee-45ba-4541-8af8-e392018ef468" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.298s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG nova.objects.instance [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'flavor' on Instance uuid ed09e4b4-dd5f-4200-be08-7260da0c7d85 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.962s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "01f10bee-45ba-4541-8af8-e392018ef468" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "01f10bee-45ba-4541-8af8-e392018ef468" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:07 user nova-compute[72019]: INFO nova.compute.manager [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Detaching volume f89394ef-17be-4375-8971-c9fa45166bee
Apr 14 13:25:07 user nova-compute[72019]: INFO nova.virt.block_device [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Attempting to driver detach volume f89394ef-17be-4375-8971-c9fa45166bee from mountpoint /dev/vdb
Apr 14 13:25:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Attempting to detach device vdb from instance 01f10bee-45ba-4541-8af8-e392018ef468 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:25:07 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:25:07 user nova-compute[72019]:   <source dev="/dev/sdi"/>
Apr 14 13:25:07 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:25:07 user nova-compute[72019]:   <serial>f89394ef-17be-4375-8971-c9fa45166bee</serial>
Apr 14 13:25:07 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:25:07 user nova-compute[72019]: </disk>
Apr 14 13:25:07 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:25:07 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Successfully detached device vdb from instance 01f10bee-45ba-4541-8af8-e392018ef468 from the persistent domain config.
Apr 14 13:25:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01f10bee-45ba-4541-8af8-e392018ef468 from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:25:07 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:25:07 user nova-compute[72019]:   <source dev="/dev/sdi"/>
Apr 14 13:25:07 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:25:07 user nova-compute[72019]:   <serial>f89394ef-17be-4375-8971-c9fa45166bee</serial>
Apr 14 13:25:07 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:25:07 user nova-compute[72019]: </disk>
Apr 14 13:25:07 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478707.7932737, 01f10bee-45ba-4541-8af8-e392018ef468 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01f10bee-45ba-4541-8af8-e392018ef468 {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:25:07 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Successfully detached device vdb from instance 01f10bee-45ba-4541-8af8-e392018ef468 from the live domain config.
Apr 14 13:25:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNXbznay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:25:07 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:25:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:07 user nova-compute[72019]: INFO nova.compute.manager [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Detaching volume a20ffa11-b01c-45cc-8a71-f534c44f8568
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cea97e2-c42f-430f-a707-630a903c1a7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:25:07 user nova-compute[72019]: No targets found.
Apr 14 13:25:07 user nova-compute[72019]: iSNS:
Apr 14 13:25:07 user nova-compute[72019]: No targets found.
Apr 14 13:25:07 user nova-compute[72019]: STATIC:
Apr 14 13:25:07 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc
Apr 14 13:25:07 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:07 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:07 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0
Apr 14 13:25:07 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:07 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:07 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:25:07 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:07 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:07 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568
Apr 14 13:25:07 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:07 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:07 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee
Apr 14 13:25:07 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:07 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:07 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29
Apr 14 13:25:07 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:07 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:07 user nova-compute[72019]: FIRMWARE:
Apr 14 13:25:07 user nova-compute[72019]: No targets found.
Apr 14 13:25:07 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:25:07 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:25:07 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e626515-9d90-41ab-85fb-2903318f1f7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:07 user nova-compute[72019]: INFO nova.virt.block_device [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Attempting to driver detach volume a20ffa11-b01c-45cc-8a71-f534c44f8568 from mountpoint /dev/vdc
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[abedb0a6-997b-44bb-b67c-e029f58dae6a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:25:07 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:25:07 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:25:07 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:25:07 user nova-compute[72019]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)
Apr 14 13:25:07 user nova-compute[72019]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee (non-flash)
Apr 14 13:25:07 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:25:07 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:25:07 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:25:07 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:25:07 user nova-compute[72019]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)
Apr 14 13:25:07 user nova-compute[72019]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee (non-flash)
Apr 14 13:25:07 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74882d15a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee'): ({'sdi'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Removing single pathed devices sdi {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Attempting to detach device vdc from instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:25:07 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:25:07 user nova-compute[72019]:   <source dev="/dev/sdh"/>
Apr 14 13:25:07 user nova-compute[72019]:   <target dev="vdc" bus="virtio"/>
Apr 14 13:25:07 user nova-compute[72019]:   <serial>a20ffa11-b01c-45cc-8a71-f534c44f8568</serial>
Apr 14 13:25:07 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 13:25:07 user nova-compute[72019]: </disk>
Apr 14 13:25:07 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:25:07 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Successfully detached device vdc from instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 from the persistent domain config.
Apr 14 13:25:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:25:07 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:25:07 user nova-compute[72019]:   <source dev="/dev/sdh"/>
Apr 14 13:25:07 user nova-compute[72019]:   <target dev="vdc" bus="virtio"/>
Apr 14 13:25:07 user nova-compute[72019]:   <serial>a20ffa11-b01c-45cc-8a71-f534c44f8568</serial>
Apr 14 13:25:07 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 13:25:07 user nova-compute[72019]: </disk>
Apr 14 13:25:07 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d390ba1b-68c3-423b-80d3-a6bdbbeb4ca1]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29e97bb-4c10-4949-8cd3-a2fde054fe49]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flushing IO for device /dev/sdi {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b2f1cc-8410-4732-bb1e-b6aeba9df4e5]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:25:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d299133-d7b5-4295-a47c-c7bb44099b6d]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] SCSI volumes sdi have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[765acf4a-bbf3-44e1-929a-87cc724bc84d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[958809be-6c91-4b06-8b52-bbb6544e6d41]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee, portal: 172.16.0.220,3260]
Apr 14 13:25:08 user nova-compute[72019]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee, portal: 172.16.0.220,3260] successful.
Apr 14 13:25:08 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89394ef-17be-4375-8971-c9fa45166bee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3314b2e-ffe7-43d2-946e-dd751d5cbd33]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] <== disconnect_volume: return (346ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478708.3766322, ed09e4b4-dd5f-4200-be08-7260da0c7d85 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:25:08 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Successfully detached device vdc from instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 from the live domain config.
Apr 14 13:25:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxJMterD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:25:08 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc951ae-a10b-4918-873a-4a9c28f29390]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:25:08 user nova-compute[72019]: No targets found.
Apr 14 13:25:08 user nova-compute[72019]: iSNS:
Apr 14 13:25:08 user nova-compute[72019]: No targets found.
Apr 14 13:25:08 user nova-compute[72019]: STATIC:
Apr 14 13:25:08 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc
Apr 14 13:25:08 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:08 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:08 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0
Apr 14 13:25:08 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:08 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:08 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:25:08 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:08 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:08 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568
Apr 14 13:25:08 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:08 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:08 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29
Apr 14 13:25:08 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:25:08 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:25:08 user nova-compute[72019]: FIRMWARE:
Apr 14 13:25:08 user nova-compute[72019]: No targets found.
Apr 14 13:25:08 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:25:08 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:25:08 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a00cb6d-93b8-41a5-9b3f-85b257ab2d11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c356e6-b0bc-4e8f-82aa-7de7473bba7a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:25:08 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:25:08 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:25:08 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:25:08 user nova-compute[72019]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)
Apr 14 13:25:08 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:25:08 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:25:08 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:25:08 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:25:08 user nova-compute[72019]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 (non-flash)
Apr 14 13:25:08 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74900f1360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568'): ({'sdh'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Removing single pathed devices sdh {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[838d8534-b415-4178-9cef-61581790dccd]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa69e738-2056-4b1e-ae13-dc9608d21218]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flushing IO for device /dev/sdh {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cebb96-4bac-4ee9-a934-5d0830a3f542]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.057s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[54289181-9a3f-43bf-9f26-b1ae9db9c23b]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] SCSI volumes sdh have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6c9b32-1123-4dd8-85a1-aeafb326c49b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --logout" returned: 0 in 0.116s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[837de5f4-041b-4817-9e75-e2a6fc9046ff]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568, portal: 172.16.0.220,3260]
Apr 14 13:25:08 user nova-compute[72019]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568, portal: 172.16.0.220,3260] successful.
Apr 14 13:25:08 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a20ffa11-b01c-45cc-8a71-f534c44f8568 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[49620e74-7653-4eac-adb2-277141c9c574]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] <== disconnect_volume: return (409ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:25:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG nova.objects.instance [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'flavor' on Instance uuid 01f10bee-45ba-4541-8af8-e392018ef468 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "01f10bee-45ba-4541-8af8-e392018ef468" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.033s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:25:09 user nova-compute[72019]: INFO nova.compute.claims [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Claim successful on node user
Apr 14 13:25:09 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG nova.objects.instance [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'flavor' on Instance uuid ed09e4b4-dd5f-4200-be08-7260da0c7d85 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.081s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:25:09 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:25:09 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:25:09 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG nova.policy [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:25:10 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Creating image(s)
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "/opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "/opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.147s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk 1073741824" returned: 0 in 0.071s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:10 user nova-compute[72019]: INFO nova.compute.manager [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Terminating instance
Apr 14 13:25:10 user nova-compute[72019]: DEBUG nova.compute.manager [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.154s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Successfully created port: 3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Cannot resize image /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'migration_context' on Instance uuid f7df0d0b-535b-4a60-a050-ddd6449e3c4d {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Ensure instance console log exists: /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-affb6821-cec9-4f43-906e-088673d79b75 req-622b408b-c71d-4fbc-b574-a0773c61c03e service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Received event network-vif-unplugged-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-affb6821-cec9-4f43-906e-088673d79b75 req-622b408b-c71d-4fbc-b574-a0773c61c03e service nova] Acquiring lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-affb6821-cec9-4f43-906e-088673d79b75 req-622b408b-c71d-4fbc-b574-a0773c61c03e service nova] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-affb6821-cec9-4f43-906e-088673d79b75 req-622b408b-c71d-4fbc-b574-a0773c61c03e service nova] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-affb6821-cec9-4f43-906e-088673d79b75 req-622b408b-c71d-4fbc-b574-a0773c61c03e service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] No waiting events found dispatching network-vif-unplugged-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:25:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-affb6821-cec9-4f43-906e-088673d79b75 req-622b408b-c71d-4fbc-b574-a0773c61c03e service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Received event network-vif-unplugged-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:11 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Instance destroyed successfully.
Apr 14 13:25:11 user nova-compute[72019]: DEBUG nova.objects.instance [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'resources' on Instance uuid ed09e4b4-dd5f-4200-be08-7260da0c7d85 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1437128410',display_name='tempest-AttachVolumeTestJSON-server-1437128410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1437128410',id=31,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKA26k0WYP8XCfCvBrpz4NFr3gf94+RBw4IFB1YpeSMcv8eoVWhtwKyWANDeja3cxf2gVPhnwh2tbJr3VvhOmIT9iaH6e76r9kQFye1uFeSzTKshoLyYKFXls3FDPOClA==',key_name='tempest-keypair-531734162',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:22:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a82aa8e6724a41e1a4e4d7783876536e',ramdisk_id='',reservation_id='r-z4n913zw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-581564101',owner_user_name='tempest-AttachVolumeTestJSON-581564101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:22:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e4e432ab0d448db8c2437e40cbe0cd',uuid=ed09e4b4-dd5f-4200-be08-7260da0c7d85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "address": "fa:16:3e:66:c1:bf", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a44c0e9-c7", "ovs_interfaceid": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converting VIF {"id": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "address": "fa:16:3e:66:c1:bf", "network": {"id": "70521388-2232-4fd0-a1b4-41b6901ac702", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1584855163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a82aa8e6724a41e1a4e4d7783876536e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a44c0e9-c7", "ovs_interfaceid": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:c1:bf,bridge_name='br-int',has_traffic_filtering=True,id=0a44c0e9-c717-4924-b996-4f0db4d1c1a3,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a44c0e9-c7') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG os_vif [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:c1:bf,bridge_name='br-int',has_traffic_filtering=True,id=0a44c0e9-c717-4924-b996-4f0db4d1c1a3,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a44c0e9-c7') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a44c0e9-c7, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:25:11 user nova-compute[72019]: INFO os_vif [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:c1:bf,bridge_name='br-int',has_traffic_filtering=True,id=0a44c0e9-c717-4924-b996-4f0db4d1c1a3,network=Network(70521388-2232-4fd0-a1b4-41b6901ac702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a44c0e9-c7')
Apr 14 13:25:11 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Deleting instance files /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85_del
Apr 14 13:25:11 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Deletion of /opt/stack/data/nova/instances/ed09e4b4-dd5f-4200-be08-7260da0c7d85_del complete
Apr 14 13:25:11 user nova-compute[72019]: INFO nova.compute.manager [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 14 13:25:11 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Successfully updated port: 3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquired lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG nova.compute.manager [req-5b328bba-d8bf-45d6-a95b-7061b5d198af req-b4e90880-7a78-49c9-88bb-658b52115afa service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received event network-changed-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG nova.compute.manager [req-5b328bba-d8bf-45d6-a95b-7061b5d198af req-b4e90880-7a78-49c9-88bb-658b52115afa service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Refreshing instance network info cache due to event network-changed-3cf56142-3eb9-481f-9e81-b839a2106ab3. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5b328bba-d8bf-45d6-a95b-7061b5d198af req-b4e90880-7a78-49c9-88bb-658b52115afa service nova] Acquiring lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:25:11 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Updating instance_info_cache with network_info: [{"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Releasing lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Instance network_info: |[{"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5b328bba-d8bf-45d6-a95b-7061b5d198af req-b4e90880-7a78-49c9-88bb-658b52115afa service nova] Acquired lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.network.neutron [req-5b328bba-d8bf-45d6-a95b-7061b5d198af req-b4e90880-7a78-49c9-88bb-658b52115afa service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Refreshing network info cache for port 3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Start _get_guest_xml network_info=[{"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:25:12 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:25:12 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1289054872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1289054872',id=34,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM58epGqhtKxGXJ/+xFhEOxUulN613XjttUVnaW18pLMGQ2SIMhHBKaAkyjthPjHjJkakSAYkqQ670pGkRR5B7mIl8EE7DrTXrHs+Sy5Z42MrNXXIqNpGIAl9c8To2l2Sg==',key_name='tempest-keypair-321023180',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0fee50983a4e31b1689dc77b1c4db1',ramdisk_id='',reservation_id='r-vz8bjy3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1344633518',owner_user_name='tempest-AttachVolumeShelveTestJSON-1344633518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:25:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04370605aec40a0a53a080c1e8bf8a8',uuid=f7df0d0b-535b-4a60-a050-ddd6449e3c4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converting VIF {"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ff:1f,bridge_name='br-int',has_traffic_filtering=True,id=3cf56142-3eb9-481f-9e81-b839a2106ab3,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf56142-3e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'pci_devices' on Instance uuid f7df0d0b-535b-4a60-a050-ddd6449e3c4d {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:25:12 user nova-compute[72019]:   <uuid>f7df0d0b-535b-4a60-a050-ddd6449e3c4d</uuid>
Apr 14 13:25:12 user nova-compute[72019]:   <name>instance-00000022</name>
Apr 14 13:25:12 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:25:12 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:25:12 user nova-compute[72019]:   <metadata>
Apr 14 13:25:12 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:25:12 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:25:12 user nova-compute[72019]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1289054872</nova:name>
Apr 14 13:25:12 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:25:12</nova:creationTime>
Apr 14 13:25:12 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:25:12 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:25:12 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:25:12 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:25:12 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:25:12 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:25:12 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:25:12 user nova-compute[72019]:       <nova:owner>
Apr 14 13:25:12 user nova-compute[72019]:         <nova:user uuid="f04370605aec40a0a53a080c1e8bf8a8">tempest-AttachVolumeShelveTestJSON-1344633518-project-member</nova:user>
Apr 14 13:25:12 user nova-compute[72019]:         <nova:project uuid="8f0fee50983a4e31b1689dc77b1c4db1">tempest-AttachVolumeShelveTestJSON-1344633518</nova:project>
Apr 14 13:25:12 user nova-compute[72019]:       </nova:owner>
Apr 14 13:25:12 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:25:12 user nova-compute[72019]:       <nova:ports>
Apr 14 13:25:12 user nova-compute[72019]:         <nova:port uuid="3cf56142-3eb9-481f-9e81-b839a2106ab3">
Apr 14 13:25:12 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 13:25:12 user nova-compute[72019]:         </nova:port>
Apr 14 13:25:12 user nova-compute[72019]:       </nova:ports>
Apr 14 13:25:12 user nova-compute[72019]:     </nova:instance>
Apr 14 13:25:12 user nova-compute[72019]:   </metadata>
Apr 14 13:25:12 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:25:12 user nova-compute[72019]:     <system>
Apr 14 13:25:12 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:25:12 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:25:12 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:25:12 user nova-compute[72019]:       <entry name="serial">f7df0d0b-535b-4a60-a050-ddd6449e3c4d</entry>
Apr 14 13:25:12 user nova-compute[72019]:       <entry name="uuid">f7df0d0b-535b-4a60-a050-ddd6449e3c4d</entry>
Apr 14 13:25:12 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:25:12 user nova-compute[72019]:     </system>
Apr 14 13:25:12 user nova-compute[72019]:   </sysinfo>
Apr 14 13:25:12 user nova-compute[72019]:   <os>
Apr 14 13:25:12 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:25:12 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:25:12 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:25:12 user nova-compute[72019]:   </os>
Apr 14 13:25:12 user nova-compute[72019]:   <features>
Apr 14 13:25:12 user nova-compute[72019]:     <acpi/>
Apr 14 13:25:12 user nova-compute[72019]:     <apic/>
Apr 14 13:25:12 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:25:12 user nova-compute[72019]:   </features>
Apr 14 13:25:12 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:25:12 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:25:12 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:25:12 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:25:12 user nova-compute[72019]:   </clock>
Apr 14 13:25:12 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:25:12 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:25:12 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:25:12 user nova-compute[72019]:   </cpu>
Apr 14 13:25:12 user nova-compute[72019]:   <devices>
Apr 14 13:25:12 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:25:12 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:25:12 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk"/>
Apr 14 13:25:12 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:25:12 user nova-compute[72019]:     </disk>
Apr 14 13:25:12 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:25:12 user nova-compute[72019]:       <mac address="fa:16:3e:d2:ff:1f"/>
Apr 14 13:25:12 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:25:12 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:25:12 user nova-compute[72019]:       <target dev="tap3cf56142-3e"/>
Apr 14 13:25:12 user nova-compute[72019]:     </interface>
Apr 14 13:25:12 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:25:12 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/console.log" append="off"/>
Apr 14 13:25:12 user nova-compute[72019]:     </serial>
Apr 14 13:25:12 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:25:12 user nova-compute[72019]:     <video>
Apr 14 13:25:12 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:25:12 user nova-compute[72019]:     </video>
Apr 14 13:25:12 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:25:12 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:25:12 user nova-compute[72019]:     </rng>
Apr 14 13:25:12 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:25:12 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:25:12 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:25:12 user nova-compute[72019]:     </memballoon>
Apr 14 13:25:12 user nova-compute[72019]:   </devices>
Apr 14 13:25:12 user nova-compute[72019]: </domain>
Apr 14 13:25:12 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1289054872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1289054872',id=34,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM58epGqhtKxGXJ/+xFhEOxUulN613XjttUVnaW18pLMGQ2SIMhHBKaAkyjthPjHjJkakSAYkqQ670pGkRR5B7mIl8EE7DrTXrHs+Sy5Z42MrNXXIqNpGIAl9c8To2l2Sg==',key_name='tempest-keypair-321023180',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f0fee50983a4e31b1689dc77b1c4db1',ramdisk_id='',reservation_id='r-vz8bjy3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1344633518',owner_user_name='tempest-AttachVolumeShelveTestJSON-1344633518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:25:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04370605aec40a0a53a080c1e8bf8a8',uuid=f7df0d0b-535b-4a60-a050-ddd6449e3c4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converting VIF {"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ff:1f,bridge_name='br-int',has_traffic_filtering=True,id=3cf56142-3eb9-481f-9e81-b839a2106ab3,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf56142-3e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG os_vif [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ff:1f,bridge_name='br-int',has_traffic_filtering=True,id=3cf56142-3eb9-481f-9e81-b839a2106ab3,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf56142-3e') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cf56142-3e, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3cf56142-3e, col_values=(('external_ids', {'iface-id': '3cf56142-3eb9-481f-9e81-b839a2106ab3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:ff:1f', 'vm-uuid': 'f7df0d0b-535b-4a60-a050-ddd6449e3c4d'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:12 user nova-compute[72019]: INFO os_vif [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ff:1f,bridge_name='br-int',has_traffic_filtering=True,id=3cf56142-3eb9-481f-9e81-b839a2106ab3,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf56142-3e')
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:25:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] No VIF found with MAC fa:16:3e:d2:ff:1f, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:25:13 user nova-compute[72019]: DEBUG nova.compute.manager [req-0e49d6ea-91b2-4a16-b061-4a37ed323e3a req-c4700941-3966-4ba7-aea0-55acfe1dcedd service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Received event network-vif-plugged-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0e49d6ea-91b2-4a16-b061-4a37ed323e3a req-c4700941-3966-4ba7-aea0-55acfe1dcedd service nova] Acquiring lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0e49d6ea-91b2-4a16-b061-4a37ed323e3a req-c4700941-3966-4ba7-aea0-55acfe1dcedd service nova] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0e49d6ea-91b2-4a16-b061-4a37ed323e3a req-c4700941-3966-4ba7-aea0-55acfe1dcedd service nova] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:13 user nova-compute[72019]: DEBUG nova.compute.manager [req-0e49d6ea-91b2-4a16-b061-4a37ed323e3a req-c4700941-3966-4ba7-aea0-55acfe1dcedd service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] No waiting events found dispatching network-vif-plugged-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:25:13 user nova-compute[72019]: WARNING nova.compute.manager [req-0e49d6ea-91b2-4a16-b061-4a37ed323e3a req-c4700941-3966-4ba7-aea0-55acfe1dcedd service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Received unexpected event network-vif-plugged-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 for instance with vm_state active and task_state deleting.
Apr 14 13:25:13 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:25:13 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Took 1.59 seconds to deallocate network for instance.
Apr 14 13:25:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:13 user nova-compute[72019]: DEBUG nova.network.neutron [req-5b328bba-d8bf-45d6-a95b-7061b5d198af req-b4e90880-7a78-49c9-88bb-658b52115afa service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Updated VIF entry in instance network info cache for port 3cf56142-3eb9-481f-9e81-b839a2106ab3. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:25:13 user nova-compute[72019]: DEBUG nova.network.neutron [req-5b328bba-d8bf-45d6-a95b-7061b5d198af req-b4e90880-7a78-49c9-88bb-658b52115afa service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Updating instance_info_cache with network_info: [{"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:25:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5b328bba-d8bf-45d6-a95b-7061b5d198af req-b4e90880-7a78-49c9-88bb-658b52115afa service nova] Releasing lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:25:13 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:25:13 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:25:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:13 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Deleted allocations for instance ed09e4b4-dd5f-4200-be08-7260da0c7d85
Apr 14 13:25:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "ed09e4b4-dd5f-4200-be08-7260da0c7d85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.145s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:13 user nova-compute[72019]: DEBUG nova.compute.manager [req-ce21e4a7-c3f9-4431-a522-162ea993dc36 req-2987c76c-52ff-42c1-9d5d-bd15701fadb6 service nova] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Received event network-vif-deleted-0a44c0e9-c717-4924-b996-4f0db4d1c1a3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-cf901526-7f94-4e83-9cd5-35e4557c2a5c req-ef627472-baf9-49f4-b022-4d0b9336fea7 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received event network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cf901526-7f94-4e83-9cd5-35e4557c2a5c req-ef627472-baf9-49f4-b022-4d0b9336fea7 service nova] Acquiring lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cf901526-7f94-4e83-9cd5-35e4557c2a5c req-ef627472-baf9-49f4-b022-4d0b9336fea7 service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-cf901526-7f94-4e83-9cd5-35e4557c2a5c req-ef627472-baf9-49f4-b022-4d0b9336fea7 service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-cf901526-7f94-4e83-9cd5-35e4557c2a5c req-ef627472-baf9-49f4-b022-4d0b9336fea7 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] No waiting events found dispatching network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:25:14 user nova-compute[72019]: WARNING nova.compute.manager [req-cf901526-7f94-4e83-9cd5-35e4557c2a5c req-ef627472-baf9-49f4-b022-4d0b9336fea7 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received unexpected event network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance with vm_state building and task_state spawning.
Apr 14 13:25:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478716.422289, f7df0d0b-535b-4a60-a050-ddd6449e3c4d => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:25:16 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] VM Resumed (Lifecycle Event)
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:25:16 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Instance spawned successfully.
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:25:16 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478716.4256055, f7df0d0b-535b-4a60-a050-ddd6449e3c4d => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:25:16 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] VM Started (Lifecycle Event)
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-89aacac7-76ed-461c-8e1b-513e1da426ce req-87a7fce0-750e-4ac5-9383-de066e7ba16d service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received event network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-89aacac7-76ed-461c-8e1b-513e1da426ce req-87a7fce0-750e-4ac5-9383-de066e7ba16d service nova] Acquiring lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-89aacac7-76ed-461c-8e1b-513e1da426ce req-87a7fce0-750e-4ac5-9383-de066e7ba16d service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-89aacac7-76ed-461c-8e1b-513e1da426ce req-87a7fce0-750e-4ac5-9383-de066e7ba16d service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-89aacac7-76ed-461c-8e1b-513e1da426ce req-87a7fce0-750e-4ac5-9383-de066e7ba16d service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] No waiting events found dispatching network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:25:16 user nova-compute[72019]: WARNING nova.compute.manager [req-89aacac7-76ed-461c-8e1b-513e1da426ce req-87a7fce0-750e-4ac5-9383-de066e7ba16d service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received unexpected event network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance with vm_state building and task_state spawning.
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:25:16 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:25:16 user nova-compute[72019]: INFO nova.compute.manager [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Took 6.44 seconds to spawn the instance on the hypervisor.
Apr 14 13:25:16 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:25:16 user nova-compute[72019]: INFO nova.compute.manager [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Took 7.38 seconds to build instance.
Apr 14 13:25:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.488s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "911be82f-bcf1-4b02-a218-ab977b28afe1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:25:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:21 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:25:21 user nova-compute[72019]: INFO nova.compute.claims [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Claim successful on node user
Apr 14 13:25:21 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:25:21 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:25:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:25:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:25:21 user nova-compute[72019]: DEBUG nova.network.neutron [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:25:21 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:25:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG nova.policy [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:25:22 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Creating image(s)
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "/opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "/opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "/opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk 1073741824" returned: 0 in 0.051s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.144s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Cannot resize image /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG nova.objects.instance [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'migration_context' on Instance uuid 911be82f-bcf1-4b02-a218-ab977b28afe1 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Ensure instance console log exists: /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:22 user nova-compute[72019]: DEBUG nova.network.neutron [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Successfully created port: 98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:25:23 user nova-compute[72019]: DEBUG nova.network.neutron [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Successfully updated port: 98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:25:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "refresh_cache-911be82f-bcf1-4b02-a218-ab977b28afe1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:25:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquired lock "refresh_cache-911be82f-bcf1-4b02-a218-ab977b28afe1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:25:23 user nova-compute[72019]: DEBUG nova.network.neutron [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:25:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-4da04fcc-ed32-4419-ac26-49db276fd9ff req-7535f9a2-0a3d-42a8-a88b-253819044770 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Received event network-changed-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-4da04fcc-ed32-4419-ac26-49db276fd9ff req-7535f9a2-0a3d-42a8-a88b-253819044770 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Refreshing instance network info cache due to event network-changed-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:25:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4da04fcc-ed32-4419-ac26-49db276fd9ff req-7535f9a2-0a3d-42a8-a88b-253819044770 service nova] Acquiring lock "refresh_cache-911be82f-bcf1-4b02-a218-ab977b28afe1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:25:23 user nova-compute[72019]: DEBUG nova.network.neutron [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Updating instance_info_cache with network_info: [{"id": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "address": "fa:16:3e:bb:f3:4c", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c3bad4-02", "ovs_interfaceid": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Releasing lock "refresh_cache-911be82f-bcf1-4b02-a218-ab977b28afe1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Instance network_info: |[{"id": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "address": "fa:16:3e:bb:f3:4c", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c3bad4-02", "ovs_interfaceid": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4da04fcc-ed32-4419-ac26-49db276fd9ff req-7535f9a2-0a3d-42a8-a88b-253819044770 service nova] Acquired lock "refresh_cache-911be82f-bcf1-4b02-a218-ab977b28afe1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-4da04fcc-ed32-4419-ac26-49db276fd9ff req-7535f9a2-0a3d-42a8-a88b-253819044770 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Refreshing network info cache for port 98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Start _get_guest_xml network_info=[{"id": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "address": "fa:16:3e:bb:f3:4c", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c3bad4-02", "ovs_interfaceid": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:25:24 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:25:24 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2015588570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2015588570',id=35,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a573d19b775642bba2f2883e0005492d',ramdisk_id='',reservation_id='r-unbne1fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-740277424',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:25:22Z,user_data=None,user_id='ebc2d46bc1794568841df20b046356c7',uuid=911be82f-bcf1-4b02-a218-ab977b28afe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "address": "fa:16:3e:bb:f3:4c", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c3bad4-02", "ovs_interfaceid": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converting VIF {"id": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "address": "fa:16:3e:bb:f3:4c", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c3bad4-02", "ovs_interfaceid": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f3:4c,bridge_name='br-int',has_traffic_filtering=True,id=98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c3bad4-02') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.objects.instance [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'pci_devices' on Instance uuid 911be82f-bcf1-4b02-a218-ab977b28afe1 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:25:24 user nova-compute[72019]:   <uuid>911be82f-bcf1-4b02-a218-ab977b28afe1</uuid>
Apr 14 13:25:24 user nova-compute[72019]:   <name>instance-00000023</name>
Apr 14 13:25:24 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:25:24 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:25:24 user nova-compute[72019]:   <metadata>
Apr 14 13:25:24 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:25:24 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:25:24 user nova-compute[72019]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2015588570</nova:name>
Apr 14 13:25:24 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:25:24</nova:creationTime>
Apr 14 13:25:24 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:25:24 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:25:24 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:25:24 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:25:24 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:25:24 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:25:24 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:25:24 user nova-compute[72019]:       <nova:owner>
Apr 14 13:25:24 user nova-compute[72019]:         <nova:user uuid="ebc2d46bc1794568841df20b046356c7">tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member</nova:user>
Apr 14 13:25:24 user nova-compute[72019]:         <nova:project uuid="a573d19b775642bba2f2883e0005492d">tempest-ServerBootFromVolumeStableRescueTest-740277424</nova:project>
Apr 14 13:25:24 user nova-compute[72019]:       </nova:owner>
Apr 14 13:25:24 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:25:24 user nova-compute[72019]:       <nova:ports>
Apr 14 13:25:24 user nova-compute[72019]:         <nova:port uuid="98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75">
Apr 14 13:25:24 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 13:25:24 user nova-compute[72019]:         </nova:port>
Apr 14 13:25:24 user nova-compute[72019]:       </nova:ports>
Apr 14 13:25:24 user nova-compute[72019]:     </nova:instance>
Apr 14 13:25:24 user nova-compute[72019]:   </metadata>
Apr 14 13:25:24 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:25:24 user nova-compute[72019]:     <system>
Apr 14 13:25:24 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:25:24 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:25:24 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:25:24 user nova-compute[72019]:       <entry name="serial">911be82f-bcf1-4b02-a218-ab977b28afe1</entry>
Apr 14 13:25:24 user nova-compute[72019]:       <entry name="uuid">911be82f-bcf1-4b02-a218-ab977b28afe1</entry>
Apr 14 13:25:24 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:25:24 user nova-compute[72019]:     </system>
Apr 14 13:25:24 user nova-compute[72019]:   </sysinfo>
Apr 14 13:25:24 user nova-compute[72019]:   <os>
Apr 14 13:25:24 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:25:24 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:25:24 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:25:24 user nova-compute[72019]:   </os>
Apr 14 13:25:24 user nova-compute[72019]:   <features>
Apr 14 13:25:24 user nova-compute[72019]:     <acpi/>
Apr 14 13:25:24 user nova-compute[72019]:     <apic/>
Apr 14 13:25:24 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:25:24 user nova-compute[72019]:   </features>
Apr 14 13:25:24 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:25:24 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:25:24 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:25:24 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:25:24 user nova-compute[72019]:   </clock>
Apr 14 13:25:24 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:25:24 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:25:24 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:25:24 user nova-compute[72019]:   </cpu>
Apr 14 13:25:24 user nova-compute[72019]:   <devices>
Apr 14 13:25:24 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:25:24 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:25:24 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk"/>
Apr 14 13:25:24 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:25:24 user nova-compute[72019]:     </disk>
Apr 14 13:25:24 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:25:24 user nova-compute[72019]:       <mac address="fa:16:3e:bb:f3:4c"/>
Apr 14 13:25:24 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:25:24 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:25:24 user nova-compute[72019]:       <target dev="tap98c3bad4-02"/>
Apr 14 13:25:24 user nova-compute[72019]:     </interface>
Apr 14 13:25:24 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:25:24 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/console.log" append="off"/>
Apr 14 13:25:24 user nova-compute[72019]:     </serial>
Apr 14 13:25:24 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:25:24 user nova-compute[72019]:     <video>
Apr 14 13:25:24 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:25:24 user nova-compute[72019]:     </video>
Apr 14 13:25:24 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:25:24 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:25:24 user nova-compute[72019]:     </rng>
Apr 14 13:25:24 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:25:24 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:25:24 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:25:24 user nova-compute[72019]:     </memballoon>
Apr 14 13:25:24 user nova-compute[72019]:   </devices>
Apr 14 13:25:24 user nova-compute[72019]: </domain>
Apr 14 13:25:24 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2015588570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2015588570',id=35,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a573d19b775642bba2f2883e0005492d',ramdisk_id='',reservation_id='r-unbne1fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-740277424',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:25:22Z,user_data=None,user_id='ebc2d46bc1794568841df20b046356c7',uuid=911be82f-bcf1-4b02-a218-ab977b28afe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "address": "fa:16:3e:bb:f3:4c", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c3bad4-02", "ovs_interfaceid": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converting VIF {"id": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "address": "fa:16:3e:bb:f3:4c", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c3bad4-02", "ovs_interfaceid": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f3:4c,bridge_name='br-int',has_traffic_filtering=True,id=98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c3bad4-02') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG os_vif [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f3:4c,bridge_name='br-int',has_traffic_filtering=True,id=98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c3bad4-02') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98c3bad4-02, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98c3bad4-02, col_values=(('external_ids', {'iface-id': '98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:f3:4c', 'vm-uuid': '911be82f-bcf1-4b02-a218-ab977b28afe1'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:24 user nova-compute[72019]: INFO os_vif [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f3:4c,bridge_name='br-int',has_traffic_filtering=True,id=98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c3bad4-02')
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] No VIF found with MAC fa:16:3e:bb:f3:4c, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-4da04fcc-ed32-4419-ac26-49db276fd9ff req-7535f9a2-0a3d-42a8-a88b-253819044770 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Updated VIF entry in instance network info cache for port 98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-4da04fcc-ed32-4419-ac26-49db276fd9ff req-7535f9a2-0a3d-42a8-a88b-253819044770 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Updating instance_info_cache with network_info: [{"id": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "address": "fa:16:3e:bb:f3:4c", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c3bad4-02", "ovs_interfaceid": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:25:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4da04fcc-ed32-4419-ac26-49db276fd9ff req-7535f9a2-0a3d-42a8-a88b-253819044770 service nova] Releasing lock "refresh_cache-911be82f-bcf1-4b02-a218-ab977b28afe1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:25:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-8c2bd64b-afab-4667-b83a-efeeb65f37d5 req-58ba6118-3543-4edc-a0e4-29cf5a331b72 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Received event network-vif-plugged-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8c2bd64b-afab-4667-b83a-efeeb65f37d5 req-58ba6118-3543-4edc-a0e4-29cf5a331b72 service nova] Acquiring lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8c2bd64b-afab-4667-b83a-efeeb65f37d5 req-58ba6118-3543-4edc-a0e4-29cf5a331b72 service nova] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8c2bd64b-afab-4667-b83a-efeeb65f37d5 req-58ba6118-3543-4edc-a0e4-29cf5a331b72 service nova] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-8c2bd64b-afab-4667-b83a-efeeb65f37d5 req-58ba6118-3543-4edc-a0e4-29cf5a331b72 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] No waiting events found dispatching network-vif-plugged-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:25:25 user nova-compute[72019]: WARNING nova.compute.manager [req-8c2bd64b-afab-4667-b83a-efeeb65f37d5 req-58ba6118-3543-4edc-a0e4-29cf5a331b72 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Received unexpected event network-vif-plugged-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 for instance with vm_state building and task_state spawning.
Apr 14 13:25:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:26 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478711.3727715, ed09e4b4-dd5f-4200-be08-7260da0c7d85 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:25:26 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] VM Stopped (Lifecycle Event)
Apr 14 13:25:26 user nova-compute[72019]: DEBUG nova.compute.manager [None req-7ab82f2b-8c88-4ab2-8cc4-0d68029fbabb None None] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478727.8157053, 911be82f-bcf1-4b02-a218-ab977b28afe1 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:25:27 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] VM Resumed (Lifecycle Event)
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:25:27 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Instance spawned successfully.
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.compute.manager [req-16cf3aa3-c903-428c-abaa-48a26a33eee1 req-051f234d-4ebc-45d3-8377-2980df053318 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Received event network-vif-plugged-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-16cf3aa3-c903-428c-abaa-48a26a33eee1 req-051f234d-4ebc-45d3-8377-2980df053318 service nova] Acquiring lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-16cf3aa3-c903-428c-abaa-48a26a33eee1 req-051f234d-4ebc-45d3-8377-2980df053318 service nova] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-16cf3aa3-c903-428c-abaa-48a26a33eee1 req-051f234d-4ebc-45d3-8377-2980df053318 service nova] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.compute.manager [req-16cf3aa3-c903-428c-abaa-48a26a33eee1 req-051f234d-4ebc-45d3-8377-2980df053318 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] No waiting events found dispatching network-vif-plugged-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:25:27 user nova-compute[72019]: WARNING nova.compute.manager [req-16cf3aa3-c903-428c-abaa-48a26a33eee1 req-051f234d-4ebc-45d3-8377-2980df053318 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Received unexpected event network-vif-plugged-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 for instance with vm_state building and task_state spawning.
Apr 14 13:25:27 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478727.817087, 911be82f-bcf1-4b02-a218-ab977b28afe1 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:25:27 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] VM Started (Lifecycle Event)
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:25:27 user nova-compute[72019]: INFO nova.compute.manager [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Took 5.82 seconds to spawn the instance on the hypervisor.
Apr 14 13:25:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:25:27 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:25:28 user nova-compute[72019]: INFO nova.compute.manager [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Took 6.66 seconds to build instance.
Apr 14 13:25:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.760s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "847e2db8-10a7-416b-ae22-1c75b6d37817" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:28 user nova-compute[72019]: INFO nova.compute.manager [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Terminating instance
Apr 14 13:25:28 user nova-compute[72019]: DEBUG nova.compute.manager [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:28 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Instance destroyed successfully.
Apr 14 13:25:28 user nova-compute[72019]: DEBUG nova.objects.instance [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lazy-loading 'resources' on Instance uuid 847e2db8-10a7-416b-ae22-1c75b6d37817 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-752836267',display_name='tempest-ServersNegativeTestJSON-server-752836267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-752836267',id=18,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4b4e44c0b8945079de567503aab3a12',ramdisk_id='',reservation_id='r-cjbszv20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-548588779',owner_user_name='tempest-ServersNegativeTestJSON-548588779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:16:52Z,user_data=None,user_id='3f713f95191542f6a23ee25669061b27',uuid=847e2db8-10a7-416b-ae22-1c75b6d37817,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "address": "fa:16:3e:76:9e:86", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf35aee5-c4", "ovs_interfaceid": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Converting VIF {"id": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "address": "fa:16:3e:76:9e:86", "network": {"id": "73061151-2d01-43ae-9ac6-841d71c038ba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1916748653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4b4e44c0b8945079de567503aab3a12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf35aee5-c4", "ovs_interfaceid": "af35aee5-c40d-47d2-82ea-3ff57c1d5495", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:9e:86,bridge_name='br-int',has_traffic_filtering=True,id=af35aee5-c40d-47d2-82ea-3ff57c1d5495,network=Network(73061151-2d01-43ae-9ac6-841d71c038ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf35aee5-c4') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG os_vif [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:9e:86,bridge_name='br-int',has_traffic_filtering=True,id=af35aee5-c40d-47d2-82ea-3ff57c1d5495,network=Network(73061151-2d01-43ae-9ac6-841d71c038ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf35aee5-c4') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf35aee5-c4, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:25:28 user nova-compute[72019]: INFO os_vif [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:9e:86,bridge_name='br-int',has_traffic_filtering=True,id=af35aee5-c40d-47d2-82ea-3ff57c1d5495,network=Network(73061151-2d01-43ae-9ac6-841d71c038ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf35aee5-c4')
Apr 14 13:25:28 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Deleting instance files /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817_del
Apr 14 13:25:28 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Deletion of /opt/stack/data/nova/instances/847e2db8-10a7-416b-ae22-1c75b6d37817_del complete
Apr 14 13:25:28 user nova-compute[72019]: INFO nova.compute.manager [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Took 0.72 seconds to destroy the instance on the hypervisor.
Apr 14 13:25:28 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:25:28 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:25:29 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:25:29 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Took 0.65 seconds to deallocate network for instance.
Apr 14 13:25:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-823743e6-4371-4e9f-afc7-f31e8bed26c9 req-de41d646-b93b-4327-9205-874ebdf74f93 service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Received event network-vif-deleted-af35aee5-c40d-47d2-82ea-3ff57c1d5495 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:29 user nova-compute[72019]: INFO nova.compute.manager [req-823743e6-4371-4e9f-afc7-f31e8bed26c9 req-de41d646-b93b-4327-9205-874ebdf74f93 service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Neutron deleted interface af35aee5-c40d-47d2-82ea-3ff57c1d5495; detaching it from the instance and deleting it from the info cache
Apr 14 13:25:29 user nova-compute[72019]: DEBUG nova.network.neutron [req-823743e6-4371-4e9f-afc7-f31e8bed26c9 req-de41d646-b93b-4327-9205-874ebdf74f93 service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:25:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-823743e6-4371-4e9f-afc7-f31e8bed26c9 req-de41d646-b93b-4327-9205-874ebdf74f93 service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Detach interface failed, port_id=af35aee5-c40d-47d2-82ea-3ff57c1d5495, reason: Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:25:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Received event network-vif-unplugged-af35aee5-c40d-47d2-82ea-3ff57c1d5495 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] Acquiring lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] No waiting events found dispatching network-vif-unplugged-af35aee5-c40d-47d2-82ea-3ff57c1d5495 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:25:29 user nova-compute[72019]: WARNING nova.compute.manager [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Received unexpected event network-vif-unplugged-af35aee5-c40d-47d2-82ea-3ff57c1d5495 for instance with vm_state deleted and task_state None.
Apr 14 13:25:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Received event network-vif-plugged-af35aee5-c40d-47d2-82ea-3ff57c1d5495 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] Acquiring lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] No waiting events found dispatching network-vif-plugged-af35aee5-c40d-47d2-82ea-3ff57c1d5495 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:25:29 user nova-compute[72019]: WARNING nova.compute.manager [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Received unexpected event network-vif-plugged-af35aee5-c40d-47d2-82ea-3ff57c1d5495 for instance with vm_state deleted and task_state None.
Apr 14 13:25:30 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:25:30 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:25:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.508s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:30 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Deleted allocations for instance 847e2db8-10a7-416b-ae22-1c75b6d37817
Apr 14 13:25:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "847e2db8-10a7-416b-ae22-1c75b6d37817" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.107s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:41 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:25:41 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:25:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:25:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:25:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:25:41 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating instance_info_cache with network_info: [{"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478728.7346768, 847e2db8-10a7-416b-ae22-1c75b6d37817 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:25:43 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] VM Stopped (Lifecycle Event)
Apr 14 13:25:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-495106b0-ef0a-4197-9fd7-874f59a0b771 None None] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:25:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:25:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:25:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:25:45 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:25:45 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:25:45 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7569MB free_disk=26.104854583740234GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:25:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 775293fc-1773-407d-bf49-fccfe849f440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 49467859-954f-498d-b520-587c7f38effc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 01f10bee-45ba-4541-8af8-e392018ef468 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:25:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "01f10bee-45ba-4541-8af8-e392018ef468" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "01f10bee-45ba-4541-8af8-e392018ef468" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "01f10bee-45ba-4541-8af8-e392018ef468-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "01f10bee-45ba-4541-8af8-e392018ef468-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "01f10bee-45ba-4541-8af8-e392018ef468-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:57 user nova-compute[72019]: INFO nova.compute.manager [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Terminating instance
Apr 14 13:25:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-a75fe7b0-7c77-4c5d-ab49-1b3dd1108533 req-a8daec3d-6770-48f9-b767-3eb0a03107f6 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Received event network-vif-unplugged-45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a75fe7b0-7c77-4c5d-ab49-1b3dd1108533 req-a8daec3d-6770-48f9-b767-3eb0a03107f6 service nova] Acquiring lock "01f10bee-45ba-4541-8af8-e392018ef468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a75fe7b0-7c77-4c5d-ab49-1b3dd1108533 req-a8daec3d-6770-48f9-b767-3eb0a03107f6 service nova] Lock "01f10bee-45ba-4541-8af8-e392018ef468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-a75fe7b0-7c77-4c5d-ab49-1b3dd1108533 req-a8daec3d-6770-48f9-b767-3eb0a03107f6 service nova] Lock "01f10bee-45ba-4541-8af8-e392018ef468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-a75fe7b0-7c77-4c5d-ab49-1b3dd1108533 req-a8daec3d-6770-48f9-b767-3eb0a03107f6 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] No waiting events found dispatching network-vif-unplugged-45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:25:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-a75fe7b0-7c77-4c5d-ab49-1b3dd1108533 req-a8daec3d-6770-48f9-b767-3eb0a03107f6 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Received event network-vif-unplugged-45024c25-a182-4df9-bec0-ab8dc8354659 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:25:58 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Instance destroyed successfully.
Apr 14 13:25:58 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'resources' on Instance uuid 01f10bee-45ba-4541-8af8-e392018ef468 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:25:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:23:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-726689788',display_name='tempest-AttachVolumeNegativeTest-server-726689788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-726689788',id=32,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg8dU1qqZxvIoy7B9MZfr1N9Qmp8/sb1Cp3tVcrzGMGiIWPn7W4DzC4kWzTVoUug8LQZNSohYWd+IFsh8GZ354HHZ2I1rxyDiEJR3c48LmMMe9YviOl0aUKv762EOVERg==',key_name='tempest-keypair-1578112597',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:23:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6833a69217034c4d85ff10bf8aa2fa5c',ramdisk_id='',reservation_id='r-gssv3g00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-893959880',owner_user_name='tempest-AttachVolumeNegativeTest-893959880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:23:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65812c6559684eddbdde33cd64ca1fba',uuid=01f10bee-45ba-4541-8af8-e392018ef468,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45024c25-a182-4df9-bec0-ab8dc8354659", "address": "fa:16:3e:35:6e:44", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45024c25-a1", "ovs_interfaceid": "45024c25-a182-4df9-bec0-ab8dc8354659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:25:58 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converting VIF {"id": "45024c25-a182-4df9-bec0-ab8dc8354659", "address": "fa:16:3e:35:6e:44", "network": {"id": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-626823139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6833a69217034c4d85ff10bf8aa2fa5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45024c25-a1", "ovs_interfaceid": "45024c25-a182-4df9-bec0-ab8dc8354659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:25:58 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=45024c25-a182-4df9-bec0-ab8dc8354659,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45024c25-a1') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:25:58 user nova-compute[72019]: DEBUG os_vif [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=45024c25-a182-4df9-bec0-ab8dc8354659,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45024c25-a1') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:25:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45024c25-a1, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:25:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:25:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:25:58 user nova-compute[72019]: INFO os_vif [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=45024c25-a182-4df9-bec0-ab8dc8354659,network=Network(2e129bf7-45b2-41b1-ba6f-5f7359c721bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45024c25-a1')
Apr 14 13:25:58 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Deleting instance files /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468_del
Apr 14 13:25:58 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Deletion of /opt/stack/data/nova/instances/01f10bee-45ba-4541-8af8-e392018ef468_del complete
Apr 14 13:25:58 user nova-compute[72019]: INFO nova.compute.manager [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 13:25:58 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:25:58 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:25:58 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:25:59 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:25:59 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Took 0.84 seconds to deallocate network for instance.
Apr 14 13:25:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:59 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:25:59 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:25:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:59 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Deleted allocations for instance 01f10bee-45ba-4541-8af8-e392018ef468
Apr 14 13:25:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "01f10bee-45ba-4541-8af8-e392018ef468" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-adeb27a1-34d9-4a91-b603-70d758be69d6 req-3051b693-e7e5-457c-a469-8740084551d8 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Received event network-vif-plugged-45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:25:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-adeb27a1-34d9-4a91-b603-70d758be69d6 req-3051b693-e7e5-457c-a469-8740084551d8 service nova] Acquiring lock "01f10bee-45ba-4541-8af8-e392018ef468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:25:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-adeb27a1-34d9-4a91-b603-70d758be69d6 req-3051b693-e7e5-457c-a469-8740084551d8 service nova] Lock "01f10bee-45ba-4541-8af8-e392018ef468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:25:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-adeb27a1-34d9-4a91-b603-70d758be69d6 req-3051b693-e7e5-457c-a469-8740084551d8 service nova] Lock "01f10bee-45ba-4541-8af8-e392018ef468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:25:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-adeb27a1-34d9-4a91-b603-70d758be69d6 req-3051b693-e7e5-457c-a469-8740084551d8 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] No waiting events found dispatching network-vif-plugged-45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:25:59 user nova-compute[72019]: WARNING nova.compute.manager [req-adeb27a1-34d9-4a91-b603-70d758be69d6 req-3051b693-e7e5-457c-a469-8740084551d8 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Received unexpected event network-vif-plugged-45024c25-a182-4df9-bec0-ab8dc8354659 for instance with vm_state deleted and task_state None.
Apr 14 13:25:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-adeb27a1-34d9-4a91-b603-70d758be69d6 req-3051b693-e7e5-457c-a469-8740084551d8 service nova] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Received event network-vif-deleted-45024c25-a182-4df9-bec0-ab8dc8354659 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG nova.objects.instance [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'flavor' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:02 user nova-compute[72019]: INFO nova.compute.manager [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Attaching volume 3452b973-eab5-49dc-b950-2f515a6c4f1b to /dev/vdb
Apr 14 13:26:02 user nova-compute[72019]: DEBUG os_brick.utils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4969cbf3-cda7-4342-9c9d-639dc1c717f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bd4085-c9ce-4d70-bb3f-dc4c4260606d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[55528b59-b3a5-466e-a3f9-74253f86885e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a61328-8bff-4d8c-824f-f26fa5b90595]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:26:02 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:26:02 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[711b13c7-e9ea-44b2-b092-cf2b8430775b]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG os_brick.utils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:26:02 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating existing volume attachment record: 2901d6df-fd67-485f-a2bd-dbe6381c03f4 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:26:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:03 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:26:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:26:03 user nova-compute[72019]: INFO nova.compute.claims [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Claim successful on node user
Apr 14 13:26:03 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:26:03 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:26:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:03 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:26:03 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:26:03 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:26:03 user nova-compute[72019]: DEBUG nova.network.neutron [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:26:03 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:26:04 user nova-compute[72019]: INFO nova.virt.block_device [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Booting with volume snapshot a67e5756-f222-42a3-915a-f268d7eef3b2 at /dev/vda
Apr 14 13:26:04 user nova-compute[72019]: DEBUG nova.policy [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:26:05 user nova-compute[72019]: DEBUG nova.network.neutron [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Successfully created port: 643e5d33-1456-403f-ba06-e25ec6713e7d {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:26:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG nova.network.neutron [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Successfully updated port: 643e5d33-1456-403f-ba06-e25ec6713e7d {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-f849f02b-f580-42b9-8f2a-16fb813fa109 req-236b72c4-bbda-4c07-9267-3a9257a1ac9f service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Received event network-changed-643e5d33-1456-403f-ba06-e25ec6713e7d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-f849f02b-f580-42b9-8f2a-16fb813fa109 req-236b72c4-bbda-4c07-9267-3a9257a1ac9f service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Refreshing instance network info cache due to event network-changed-643e5d33-1456-403f-ba06-e25ec6713e7d. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f849f02b-f580-42b9-8f2a-16fb813fa109 req-236b72c4-bbda-4c07-9267-3a9257a1ac9f service nova] Acquiring lock "refresh_cache-b8fbde75-cf77-4069-91ac-9d9c92c65c24" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f849f02b-f580-42b9-8f2a-16fb813fa109 req-236b72c4-bbda-4c07-9267-3a9257a1ac9f service nova] Acquired lock "refresh_cache-b8fbde75-cf77-4069-91ac-9d9c92c65c24" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG nova.network.neutron [req-f849f02b-f580-42b9-8f2a-16fb813fa109 req-236b72c4-bbda-4c07-9267-3a9257a1ac9f service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Refreshing network info cache for port 643e5d33-1456-403f-ba06-e25ec6713e7d {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG nova.network.neutron [req-f849f02b-f580-42b9-8f2a-16fb813fa109 req-236b72c4-bbda-4c07-9267-3a9257a1ac9f service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "refresh_cache-b8fbde75-cf77-4069-91ac-9d9c92c65c24" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG nova.network.neutron [req-f849f02b-f580-42b9-8f2a-16fb813fa109 req-236b72c4-bbda-4c07-9267-3a9257a1ac9f service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f849f02b-f580-42b9-8f2a-16fb813fa109 req-236b72c4-bbda-4c07-9267-3a9257a1ac9f service nova] Releasing lock "refresh_cache-b8fbde75-cf77-4069-91ac-9d9c92c65c24" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquired lock "refresh_cache-b8fbde75-cf77-4069-91ac-9d9c92c65c24" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG nova.network.neutron [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG nova.network.neutron [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG nova.network.neutron [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Updating instance_info_cache with network_info: [{"id": "643e5d33-1456-403f-ba06-e25ec6713e7d", "address": "fa:16:3e:d7:f1:2b", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643e5d33-14", "ovs_interfaceid": "643e5d33-1456-403f-ba06-e25ec6713e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Releasing lock "refresh_cache-b8fbde75-cf77-4069-91ac-9d9c92c65c24" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:26:06 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Instance network_info: |[{"id": "643e5d33-1456-403f-ba06-e25ec6713e7d", "address": "fa:16:3e:d7:f1:2b", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643e5d33-14", "ovs_interfaceid": "643e5d33-1456-403f-ba06-e25ec6713e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlHAIzEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:26:07 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:26:07 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:26:07 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df9b973-e8bd-4c19-88d8-85ded59e47ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:26:07 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[99be1c6f-1602-4d09-91bb-ef5cc72fd13a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b] added
Apr 14 13:26:07 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f080c3-bfa0-4ffc-9c7b-388b563ab7bb]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[849c1df4-6cda-4d7b-8967-044397607374]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlHAIzEb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlHAIzEb" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61e2027-cfed-4002-a3f3-c249f949ba42]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BlHAIzEb'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[336058e9-6cad-41c0-9822-5ac2b4932741]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e4bf5b-5145-4d3a-af5e-c5b1745720c8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:07 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:07 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:07 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:07 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:07 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:07 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:07 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:07 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1151e148-cf5a-4ab7-91e7-06738560e610]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260]
Apr 14 13:26:07 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260] successful.
Apr 14 13:26:07 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e331a7-dc7a-48c9-8ca9-3b176ec9453f]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeeafea8-9f3b-400b-879a-b84da430fafb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:07 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:07 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:07 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:07 user nova-compute[72019]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:26:07 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:07 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:07 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:07 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:07 user nova-compute[72019]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:26:07 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[df766c27-70ac-4b5c-8915-6886b60f6190]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:07 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: None {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:26:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:08 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:26:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlHAIzEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:26:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:26:08 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23561646662643261', 'path': '/dev/sdf'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:26:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561646662643261', 'path': '/dev/sdf'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:26:08 user nova-compute[72019]: DEBUG nova.objects.instance [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'flavor' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:26:08 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:26:08 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:26:08 user nova-compute[72019]:   <source dev="/dev/sdf"/>
Apr 14 13:26:08 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:26:08 user nova-compute[72019]:   <serial>3452b973-eab5-49dc-b950-2f515a6c4f1b</serial>
Apr 14 13:26:08 user nova-compute[72019]: </disk>
Apr 14 13:26:08 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No VIF found with MAC fa:16:3e:28:28:75, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.984s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG os_brick.utils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1d9055-0036-4c79-b653-ad1a443d219b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6943271f-e08f-47e1-98c3-3d9da52c2937]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f3941e-a967-4647-859e-c20a4dd19dba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d697c5fc-c381-4816-8c0f-cbfadc793a9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:09 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:26:10 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:26:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:10 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:26:10 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:26:10 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa45192-490c-4a8d-9373-a925f4f2c35c]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:10 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:26:10 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:26:10 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:26:10 user nova-compute[72019]: DEBUG os_brick.utils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:26:10 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Updating existing volume attachment record: 248590d4-eeda-4217-8859-d0035fef4cbf {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:26:11 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Stashing vm_state: active {{(pid=72019) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 13:26:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:11 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'pci_requests' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:26:12 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:26:12 user nova-compute[72019]: INFO nova.compute.claims [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Claim successful on node user
Apr 14 13:26:12 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'resources' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:26:12 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:26:12 user nova-compute[72019]: INFO nova.compute.resource_tracker [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating resource usage from migration 5169f869-26b1-4d9b-b726-ebf138fd4b74
Apr 14 13:26:12 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:26:12 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:26:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.570s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:12 user nova-compute[72019]: INFO nova.compute.manager [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Migrating
Apr 14 13:26:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:26:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:26:12 user nova-compute[72019]: INFO nova.compute.rpcapi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 14 13:26:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:26:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:26:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquired lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:26:12 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:26:13 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating instance_info_cache with network_info: [{"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:26:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Releasing lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:26:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Starting migrate_disk_and_power_off {{(pid=72019) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 13:26:13 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478758.280628, 01f10bee-45ba-4541-8af8-e392018ef468 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:26:13 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] VM Stopped (Lifecycle Event)
Apr 14 13:26:13 user nova-compute[72019]: DEBUG nova.compute.manager [None req-798af528-5df2-4c90-a08c-9f605cad639c None None] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:26:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:14 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance destroyed successfully.
Apr 14 13:26:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1306609806',display_name='tempest-ServerActionsTestJSON-server-1057847197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1306609806',id=21,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:21:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-n0fqg6y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:26:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=6e646c88-579e-4ea1-b987-da1c7194a064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1832265350-network", "vif_mac": "fa:16:3e:28:28:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1832265350-network", "vif_mac": "fa:16:3e:28:28:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_vif [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25b21f1a-fb, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:26:14 user nova-compute[72019]: INFO os_vif [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb')
Apr 14 13:26:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlHAIzEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:26:14 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-75286b2d-c642-4140-9133-18e4ed3d0971 req-c0646ebc-aac2-45e0-9295-b00cc9c58fe1 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-75286b2d-c642-4140-9133-18e4ed3d0971 req-c0646ebc-aac2-45e0-9295-b00cc9c58fe1 service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-75286b2d-c642-4140-9133-18e4ed3d0971 req-c0646ebc-aac2-45e0-9295-b00cc9c58fe1 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-75286b2d-c642-4140-9133-18e4ed3d0971 req-c0646ebc-aac2-45e0-9295-b00cc9c58fe1 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-75286b2d-c642-4140-9133-18e4ed3d0971 req-c0646ebc-aac2-45e0-9295-b00cc9c58fe1 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:26:14 user nova-compute[72019]: WARNING nova.compute.manager [req-75286b2d-c642-4140-9133-18e4ed3d0971 req-c0646ebc-aac2-45e0-9295-b00cc9c58fe1 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state active and task_state resize_migrating.
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc1033d-2366-4c58-a6bc-b832ae1a9781]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:26:14 user nova-compute[72019]: No targets found.
Apr 14 13:26:14 user nova-compute[72019]: iSNS:
Apr 14 13:26:14 user nova-compute[72019]: No targets found.
Apr 14 13:26:14 user nova-compute[72019]: STATIC:
Apr 14 13:26:14 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc
Apr 14 13:26:14 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:14 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:14 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0
Apr 14 13:26:14 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:14 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:14 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:26:14 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:14 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:14 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b
Apr 14 13:26:14 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:14 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:14 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29
Apr 14 13:26:14 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:14 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:14 user nova-compute[72019]: FIRMWARE:
Apr 14 13:26:14 user nova-compute[72019]: No targets found.
Apr 14 13:26:14 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:26:14 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:26:14 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4279d986-eefa-43be-8a6d-ba2ed199e66b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce64bd07-178a-45e8-a602-f637b1d38981]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:14 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:14 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:14 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:14 user nova-compute[72019]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:26:14 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:14 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:14 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:14 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:14 user nova-compute[72019]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:26:14 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f746464c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b'): ({'sdf'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Removing single pathed devices sdf {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a2cd0d-05fe-4fe3-a393-851a4d3c26a4]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9d614c-9192-4752-ab0b-a347177ae530]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flushing IO for device /dev/sdf {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a4f94d-9c44-499a-aa98-7332a1708604]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a5a405-8e50-4bd7-a81d-721bd236731b]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] SCSI volumes sdf have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2935b6-0427-4299-9481-16057e53987c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b136ea30-2b06-482d-bf44-94e35d1ab64b]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260]
Apr 14 13:26:14 user nova-compute[72019]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260] successful.
Apr 14 13:26:14 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a669a3-a3cf-4589-92e6-9c7f27e30e33]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== disconnect_volume: return (345ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064_resize/disk /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "cp -r /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064_resize/disk /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk" returned: 0 in 0.191s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064_resize/disk.info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk.info {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "cp -r /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064_resize/disk.info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk.info" returned: 0 in 0.049s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:26:15 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Creating image(s)
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Ensure instance console log exists: /opt/stack/data/nova/instances/b8fbde75-cf77-4069-91ac-9d9c92c65c24/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Start _get_guest_xml network_info=[{"id": "643e5d33-1456-403f-ba06-e25ec6713e7d", "address": "fa:16:3e:d7:f1:2b", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643e5d33-14", "ovs_interfaceid": "643e5d33-1456-403f-ba06-e25ec6713e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T13:26:00Z,direct_url=<?>,disk_format='qcow2',id=b79415a7-1028-47c9-b6c3-8a8a7bfce629,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-237936391',owner='818de6fa330c4c87a3b6228345d9f13a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T13:26:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '248590d4-eeda-4217-8859-d0035fef4cbf', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXWUsGgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8fbde75-cf77-4069-91ac-9d9c92c65c24', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7fde9f6-6813-4930-8d73-aa1fef697460', 'serial': 'd7fde9f6-6813-4930-8d73-aa1fef697460'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:26:15 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:26:15 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T13:26:00Z,direct_url=<?>,disk_format='qcow2',id=b79415a7-1028-47c9-b6c3-8a8a7bfce629,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-237936391',owner='818de6fa330c4c87a3b6228345d9f13a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T13:26:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXWUsGgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:26:15 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:26:15 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:26:15 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a20c04-2d16-493e-adf1-31be0df8e741]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:26:15 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f28a54f-63d8-4c95-8286-56bdd79c94ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460] added
Apr 14 13:26:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc1ba28-0e33-4c27-9ad3-e9054c3ebc6f]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b786d9eb-a38d-4d93-9af7-b0552760812a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VXWUsGgO {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VXWUsGgO" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b665ec-ca9c-4356-821e-401c6d3dafa4]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VXWUsGgO'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8150c7-59fc-4f82-aa89-01c58c9c6bb7]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41eff86-3238-4dfa-b6d1-5ec03c90fa8b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:15 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:15 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:15 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:15 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:15 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:15 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a90ef0-8af5-4df3-9408-adefbf30b29f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460, portal: 172.16.0.220,3260]
Apr 14 13:26:15 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460, portal: 172.16.0.220,3260] successful.
Apr 14 13:26:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[07db8d59-db91-4f02-83aa-b323f100bd1b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f107227f-c7cd-44a2-834c-4b731ffea3d4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:15 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:15 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:15 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:15 user nova-compute[72019]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)
Apr 14 13:26:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:15 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:15 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:15 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:15 user nova-compute[72019]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)
Apr 14 13:26:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80f9325-4338-44d0-95d7-239cc0788961]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXWUsGgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:15 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Port 25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 binding to destination host user is already ACTIVE {{(pid=72019) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquired lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23961353462623730', 'path': '/dev/sdf'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961353462623730', 'path': '/dev/sdf'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-825541492',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-825541492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-825541492',id=36,image_ref='b79415a7-1028-47c9-b6c3-8a8a7bfce629',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-w1ek030t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1645546988',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:26:04Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=b8fbde75-cf77-4069-91ac-9d9c92c65c24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "643e5d33-1456-403f-ba06-e25ec6713e7d", "address": "fa:16:3e:d7:f1:2b", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643e5d33-14", "ovs_interfaceid": "643e5d33-1456-403f-ba06-e25ec6713e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "643e5d33-1456-403f-ba06-e25ec6713e7d", "address": "fa:16:3e:d7:f1:2b", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643e5d33-14", "ovs_interfaceid": "643e5d33-1456-403f-ba06-e25ec6713e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f1:2b,bridge_name='br-int',has_traffic_filtering=True,id=643e5d33-1456-403f-ba06-e25ec6713e7d,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643e5d33-14') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.objects.instance [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lazy-loading 'pci_devices' on Instance uuid b8fbde75-cf77-4069-91ac-9d9c92c65c24 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:26:16 user nova-compute[72019]:   <uuid>b8fbde75-cf77-4069-91ac-9d9c92c65c24</uuid>
Apr 14 13:26:16 user nova-compute[72019]:   <name>instance-00000024</name>
Apr 14 13:26:16 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:26:16 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:26:16 user nova-compute[72019]:   <metadata>
Apr 14 13:26:16 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:26:16 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:26:16 user nova-compute[72019]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-825541492</nova:name>
Apr 14 13:26:16 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:26:15</nova:creationTime>
Apr 14 13:26:16 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:26:16 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:26:16 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:26:16 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:26:16 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:26:16 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:26:16 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:26:16 user nova-compute[72019]:       <nova:owner>
Apr 14 13:26:16 user nova-compute[72019]:         <nova:user uuid="bb40413bd0c3490d97b997f69c930f72">tempest-TestVolumeBootPattern-1645546988-project-member</nova:user>
Apr 14 13:26:16 user nova-compute[72019]:         <nova:project uuid="818de6fa330c4c87a3b6228345d9f13a">tempest-TestVolumeBootPattern-1645546988</nova:project>
Apr 14 13:26:16 user nova-compute[72019]:       </nova:owner>
Apr 14 13:26:16 user nova-compute[72019]:       <nova:root type="image" uuid="b79415a7-1028-47c9-b6c3-8a8a7bfce629"/>
Apr 14 13:26:16 user nova-compute[72019]:       <nova:ports>
Apr 14 13:26:16 user nova-compute[72019]:         <nova:port uuid="643e5d33-1456-403f-ba06-e25ec6713e7d">
Apr 14 13:26:16 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 13:26:16 user nova-compute[72019]:         </nova:port>
Apr 14 13:26:16 user nova-compute[72019]:       </nova:ports>
Apr 14 13:26:16 user nova-compute[72019]:     </nova:instance>
Apr 14 13:26:16 user nova-compute[72019]:   </metadata>
Apr 14 13:26:16 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:26:16 user nova-compute[72019]:     <system>
Apr 14 13:26:16 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:26:16 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:26:16 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:26:16 user nova-compute[72019]:       <entry name="serial">b8fbde75-cf77-4069-91ac-9d9c92c65c24</entry>
Apr 14 13:26:16 user nova-compute[72019]:       <entry name="uuid">b8fbde75-cf77-4069-91ac-9d9c92c65c24</entry>
Apr 14 13:26:16 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:26:16 user nova-compute[72019]:     </system>
Apr 14 13:26:16 user nova-compute[72019]:   </sysinfo>
Apr 14 13:26:16 user nova-compute[72019]:   <os>
Apr 14 13:26:16 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:26:16 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:26:16 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:26:16 user nova-compute[72019]:   </os>
Apr 14 13:26:16 user nova-compute[72019]:   <features>
Apr 14 13:26:16 user nova-compute[72019]:     <acpi/>
Apr 14 13:26:16 user nova-compute[72019]:     <apic/>
Apr 14 13:26:16 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:26:16 user nova-compute[72019]:   </features>
Apr 14 13:26:16 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:26:16 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:26:16 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:26:16 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:26:16 user nova-compute[72019]:   </clock>
Apr 14 13:26:16 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:26:16 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:26:16 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:26:16 user nova-compute[72019]:   </cpu>
Apr 14 13:26:16 user nova-compute[72019]:   <devices>
Apr 14 13:26:16 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:26:16 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:26:16 user nova-compute[72019]:       <source dev="/dev/sdf"/>
Apr 14 13:26:16 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:26:16 user nova-compute[72019]:       <serial>d7fde9f6-6813-4930-8d73-aa1fef697460</serial>
Apr 14 13:26:16 user nova-compute[72019]:     </disk>
Apr 14 13:26:16 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:26:16 user nova-compute[72019]:       <mac address="fa:16:3e:d7:f1:2b"/>
Apr 14 13:26:16 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:26:16 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:26:16 user nova-compute[72019]:       <target dev="tap643e5d33-14"/>
Apr 14 13:26:16 user nova-compute[72019]:     </interface>
Apr 14 13:26:16 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:26:16 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/b8fbde75-cf77-4069-91ac-9d9c92c65c24/console.log" append="off"/>
Apr 14 13:26:16 user nova-compute[72019]:     </serial>
Apr 14 13:26:16 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:26:16 user nova-compute[72019]:     <video>
Apr 14 13:26:16 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:26:16 user nova-compute[72019]:     </video>
Apr 14 13:26:16 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:26:16 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:26:16 user nova-compute[72019]:     </rng>
Apr 14 13:26:16 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:26:16 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:26:16 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:26:16 user nova-compute[72019]:     </memballoon>
Apr 14 13:26:16 user nova-compute[72019]:   </devices>
Apr 14 13:26:16 user nova-compute[72019]: </domain>
Apr 14 13:26:16 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-825541492',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-825541492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-825541492',id=36,image_ref='b79415a7-1028-47c9-b6c3-8a8a7bfce629',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-w1ek030t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1645546988',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:26:04Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=b8fbde75-cf77-4069-91ac-9d9c92c65c24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "643e5d33-1456-403f-ba06-e25ec6713e7d", "address": "fa:16:3e:d7:f1:2b", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643e5d33-14", "ovs_interfaceid": "643e5d33-1456-403f-ba06-e25ec6713e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "643e5d33-1456-403f-ba06-e25ec6713e7d", "address": "fa:16:3e:d7:f1:2b", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643e5d33-14", "ovs_interfaceid": "643e5d33-1456-403f-ba06-e25ec6713e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f1:2b,bridge_name='br-int',has_traffic_filtering=True,id=643e5d33-1456-403f-ba06-e25ec6713e7d,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643e5d33-14') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG os_vif [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f1:2b,bridge_name='br-int',has_traffic_filtering=True,id=643e5d33-1456-403f-ba06-e25ec6713e7d,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643e5d33-14') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap643e5d33-14, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap643e5d33-14, col_values=(('external_ids', {'iface-id': '643e5d33-1456-403f-ba06-e25ec6713e7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:f1:2b', 'vm-uuid': 'b8fbde75-cf77-4069-91ac-9d9c92c65c24'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:16 user nova-compute[72019]: INFO os_vif [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f1:2b,bridge_name='br-int',has_traffic_filtering=True,id=643e5d33-1456-403f-ba06-e25ec6713e7d,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643e5d33-14')
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] No VIF found with MAC fa:16:3e:d7:f1:2b, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-19f7aac8-d4f6-42cd-b4db-3b164fec5bd9 req-631e2c60-bcde-4a30-8444-772a5d7ba8ed service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19f7aac8-d4f6-42cd-b4db-3b164fec5bd9 req-631e2c60-bcde-4a30-8444-772a5d7ba8ed service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19f7aac8-d4f6-42cd-b4db-3b164fec5bd9 req-631e2c60-bcde-4a30-8444-772a5d7ba8ed service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-19f7aac8-d4f6-42cd-b4db-3b164fec5bd9 req-631e2c60-bcde-4a30-8444-772a5d7ba8ed service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.compute.manager [req-19f7aac8-d4f6-42cd-b4db-3b164fec5bd9 req-631e2c60-bcde-4a30-8444-772a5d7ba8ed service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:26:16 user nova-compute[72019]: WARNING nova.compute.manager [req-19f7aac8-d4f6-42cd-b4db-3b164fec5bd9 req-631e2c60-bcde-4a30-8444-772a5d7ba8ed service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state active and task_state resize_migrated.
Apr 14 13:26:16 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating instance_info_cache with network_info: [{"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Releasing lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG os_brick.utils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[080f6cf6-e6ed-42d6-9cd9-f60e0bf07ea6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[434b5c99-01e5-4158-809f-ef82113d2543]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[50539d2f-9a6e-4601-92fb-e1eec20b947d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0330ec-f5c5-402c-b8d7-13283e159a79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:26:16 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:26:17 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:26:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4e2956-4eb7-46cd-aa43-0c66ff7740cd]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:26:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:26:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:26:17 user nova-compute[72019]: DEBUG os_brick.utils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:26:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Received event network-vif-plugged-643e5d33-1456-403f-ba06-e25ec6713e7d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] Acquiring lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] Lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] Lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] No waiting events found dispatching network-vif-plugged-643e5d33-1456-403f-ba06-e25ec6713e7d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:26:18 user nova-compute[72019]: WARNING nova.compute.manager [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Received unexpected event network-vif-plugged-643e5d33-1456-403f-ba06-e25ec6713e7d for instance with vm_state building and task_state spawning.
Apr 14 13:26:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Received event network-vif-plugged-643e5d33-1456-403f-ba06-e25ec6713e7d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] Acquiring lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] Lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] Lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] No waiting events found dispatching network-vif-plugged-643e5d33-1456-403f-ba06-e25ec6713e7d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:26:18 user nova-compute[72019]: WARNING nova.compute.manager [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Received unexpected event network-vif-plugged-643e5d33-1456-403f-ba06-e25ec6713e7d for instance with vm_state building and task_state spawning.
Apr 14 13:26:20 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478780.2541919, b8fbde75-cf77-4069-91ac-9d9c92c65c24 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:26:20 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] VM Resumed (Lifecycle Event)
Apr 14 13:26:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:26:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:26:20 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Instance spawned successfully.
Apr 14 13:26:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:26:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:26:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:26:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:26:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:26:20 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:26:20 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478780.2619362, b8fbde75-cf77-4069-91ac-9d9c92c65c24 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:26:20 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] VM Started (Lifecycle Event)
Apr 14 13:26:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:26:20 user nova-compute[72019]: INFO nova.compute.manager [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Took 5.38 seconds to spawn the instance on the hypervisor.
Apr 14 13:26:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:26:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:26:20 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:26:20 user nova-compute[72019]: INFO nova.compute.manager [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Took 17.11 seconds to build instance.
Apr 14 13:26:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.202s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Starting finish_migration {{(pid=72019) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 13:26:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance directory exists: not creating {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 13:26:21 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Creating image(s)
Apr 14 13:26:21 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:26:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Cannot resize image /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Ensure instance console log exists: /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Start _get_guest_xml network_info=[{"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1832265350-network", "vif_mac": "fa:16:3e:28:28:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '6e504c6c-1cb5-461e-ade1-dfadbe1d1854', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlHAIzEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6e646c88-579e-4ea1-b987-da1c7194a064', 'attached_at': '2023-04-14T13:26:22.000000', 'detached_at': '', 'volume_id': '3452b973-eab5-49dc-b950-2f515a6c4f1b', 'serial': '3452b973-eab5-49dc-b950-2f515a6c4f1b'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:26:22 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:26:22 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlHAIzEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:26:22 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:26:22 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:26:22 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8662895-0353-4f15-800f-e3e14f77b709]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:26:22 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cef08f-2468-49c7-aed8-d070e00f7e65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b] added
Apr 14 13:26:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[103c7859-3bff-4337-a031-927578331900]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[48994d2d-b558-4ad7-bb63-ff3e2c8ea850]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlHAIzEb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlHAIzEb" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83232f3-1e96-4081-a275-772d40627ece]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BlHAIzEb'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e7007b-a2ee-480a-9c28-51a69a31c4fa]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fc0f5a-9f96-4334-b378-f58e641512dd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[810ef911-c9cd-414b-b2bb-b0f4861c4eb8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260]
Apr 14 13:26:22 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260] successful.
Apr 14 13:26:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d009e0dc-0713-4940-833b-61b9d9d62a5a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfff9a3-75de-4f23-a1f4-3666e7047edd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:26:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)
Apr 14 13:26:22 user nova-compute[72019]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:26:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ac71e2-d9c7-4cbd-869f-efda0dade6f4]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:26:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlHAIzEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23561646662643261', 'path': '/dev/sdg'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561646662643261', 'path': '/dev/sdg'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1306609806',display_name='tempest-ServerActionsTestJSON-server-1057847197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1306609806',id=21,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:21:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-n0fqg6y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:26:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=6e646c88-579e-4ea1-b987-da1c7194a064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1832265350-network", "vif_mac": "fa:16:3e:28:28:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1832265350-network", "vif_mac": "fa:16:3e:28:28:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:26:23 user nova-compute[72019]:   <uuid>6e646c88-579e-4ea1-b987-da1c7194a064</uuid>
Apr 14 13:26:23 user nova-compute[72019]:   <name>instance-00000015</name>
Apr 14 13:26:23 user nova-compute[72019]:   <memory>196608</memory>
Apr 14 13:26:23 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:26:23 user nova-compute[72019]:   <metadata>
Apr 14 13:26:23 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:26:23 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:26:23 user nova-compute[72019]:       <nova:name>tempest-ServerActionsTestJSON-server-1057847197</nova:name>
Apr 14 13:26:23 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:26:22</nova:creationTime>
Apr 14 13:26:23 user nova-compute[72019]:       <nova:flavor name="m1.micro">
Apr 14 13:26:23 user nova-compute[72019]:         <nova:memory>192</nova:memory>
Apr 14 13:26:23 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:26:23 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:26:23 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:26:23 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:26:23 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:26:23 user nova-compute[72019]:       <nova:owner>
Apr 14 13:26:23 user nova-compute[72019]:         <nova:user uuid="9169729edbd04fd5a74d2cffd0aa437f">tempest-ServerActionsTestJSON-1929049437-project-member</nova:user>
Apr 14 13:26:23 user nova-compute[72019]:         <nova:project uuid="4b197f1df57f4dee9757639cf861eb97">tempest-ServerActionsTestJSON-1929049437</nova:project>
Apr 14 13:26:23 user nova-compute[72019]:       </nova:owner>
Apr 14 13:26:23 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:26:23 user nova-compute[72019]:       <nova:ports>
Apr 14 13:26:23 user nova-compute[72019]:         <nova:port uuid="25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7">
Apr 14 13:26:23 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 13:26:23 user nova-compute[72019]:         </nova:port>
Apr 14 13:26:23 user nova-compute[72019]:       </nova:ports>
Apr 14 13:26:23 user nova-compute[72019]:     </nova:instance>
Apr 14 13:26:23 user nova-compute[72019]:   </metadata>
Apr 14 13:26:23 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:26:23 user nova-compute[72019]:     <system>
Apr 14 13:26:23 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:26:23 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:26:23 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:26:23 user nova-compute[72019]:       <entry name="serial">6e646c88-579e-4ea1-b987-da1c7194a064</entry>
Apr 14 13:26:23 user nova-compute[72019]:       <entry name="uuid">6e646c88-579e-4ea1-b987-da1c7194a064</entry>
Apr 14 13:26:23 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:26:23 user nova-compute[72019]:     </system>
Apr 14 13:26:23 user nova-compute[72019]:   </sysinfo>
Apr 14 13:26:23 user nova-compute[72019]:   <os>
Apr 14 13:26:23 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:26:23 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:26:23 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:26:23 user nova-compute[72019]:   </os>
Apr 14 13:26:23 user nova-compute[72019]:   <features>
Apr 14 13:26:23 user nova-compute[72019]:     <acpi/>
Apr 14 13:26:23 user nova-compute[72019]:     <apic/>
Apr 14 13:26:23 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:26:23 user nova-compute[72019]:   </features>
Apr 14 13:26:23 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:26:23 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:26:23 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:26:23 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:26:23 user nova-compute[72019]:   </clock>
Apr 14 13:26:23 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:26:23 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:26:23 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:26:23 user nova-compute[72019]:   </cpu>
Apr 14 13:26:23 user nova-compute[72019]:   <devices>
Apr 14 13:26:23 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:26:23 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:26:23 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk"/>
Apr 14 13:26:23 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:26:23 user nova-compute[72019]:     </disk>
Apr 14 13:26:23 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:26:23 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:26:23 user nova-compute[72019]:       <source dev="/dev/sdg"/>
Apr 14 13:26:23 user nova-compute[72019]:       <target dev="vdb" bus="virtio"/>
Apr 14 13:26:23 user nova-compute[72019]:       <serial>3452b973-eab5-49dc-b950-2f515a6c4f1b</serial>
Apr 14 13:26:23 user nova-compute[72019]:     </disk>
Apr 14 13:26:23 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:26:23 user nova-compute[72019]:       <mac address="fa:16:3e:28:28:75"/>
Apr 14 13:26:23 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:26:23 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:26:23 user nova-compute[72019]:       <target dev="tap25b21f1a-fb"/>
Apr 14 13:26:23 user nova-compute[72019]:     </interface>
Apr 14 13:26:23 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:26:23 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/console.log" append="off"/>
Apr 14 13:26:23 user nova-compute[72019]:     </serial>
Apr 14 13:26:23 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:26:23 user nova-compute[72019]:     <video>
Apr 14 13:26:23 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:26:23 user nova-compute[72019]:     </video>
Apr 14 13:26:23 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:26:23 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:26:23 user nova-compute[72019]:     </rng>
Apr 14 13:26:23 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:26:23 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:26:23 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:26:23 user nova-compute[72019]:     </memballoon>
Apr 14 13:26:23 user nova-compute[72019]:   </devices>
Apr 14 13:26:23 user nova-compute[72019]: </domain>
Apr 14 13:26:23 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1306609806',display_name='tempest-ServerActionsTestJSON-server-1057847197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1306609806',id=21,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:21:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-n0fqg6y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:26:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=6e646c88-579e-4ea1-b987-da1c7194a064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1832265350-network", "vif_mac": "fa:16:3e:28:28:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1832265350-network", "vif_mac": "fa:16:3e:28:28:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG os_vif [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25b21f1a-fb, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25b21f1a-fb, col_values=(('external_ids', {'iface-id': '25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:28:75', 'vm-uuid': '6e646c88-579e-4ea1-b987-da1c7194a064'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:23 user nova-compute[72019]: INFO os_vif [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb')
Apr 14 13:26:23 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:26:23 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No VIF found with MAC fa:16:3e:28:28:75, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:26:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-af907008-7da7-4a7f-9f92-5f465a5c21a1 req-bc807c04-b7a5-4154-807a-ddb0a2ad8f86 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-changed-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-af907008-7da7-4a7f-9f92-5f465a5c21a1 req-bc807c04-b7a5-4154-807a-ddb0a2ad8f86 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Refreshing instance network info cache due to event network-changed-bcff28e3-32d8-4f26-b087-4b1082f06cfb. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:26:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-af907008-7da7-4a7f-9f92-5f465a5c21a1 req-bc807c04-b7a5-4154-807a-ddb0a2ad8f86 service nova] Acquiring lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:26:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-af907008-7da7-4a7f-9f92-5f465a5c21a1 req-bc807c04-b7a5-4154-807a-ddb0a2ad8f86 service nova] Acquired lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:26:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-af907008-7da7-4a7f-9f92-5f465a5c21a1 req-bc807c04-b7a5-4154-807a-ddb0a2ad8f86 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Refreshing network info cache for port bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:26:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.network.neutron [req-af907008-7da7-4a7f-9f92-5f465a5c21a1 req-bc807c04-b7a5-4154-807a-ddb0a2ad8f86 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Updated VIF entry in instance network info cache for port bcff28e3-32d8-4f26-b087-4b1082f06cfb. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.network.neutron [req-af907008-7da7-4a7f-9f92-5f465a5c21a1 req-bc807c04-b7a5-4154-807a-ddb0a2ad8f86 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Updating instance_info_cache with network_info: [{"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-af907008-7da7-4a7f-9f92-5f465a5c21a1 req-bc807c04-b7a5-4154-807a-ddb0a2ad8f86 service nova] Releasing lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-6b8bc7a3-0e5c-4cc2-a7a5-afaf0a65dba5 req-44bbbb18-17f2-40b5-833d-76ef2a186403 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-changed-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-6b8bc7a3-0e5c-4cc2-a7a5-afaf0a65dba5 req-44bbbb18-17f2-40b5-833d-76ef2a186403 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Refreshing instance network info cache due to event network-changed-bcff28e3-32d8-4f26-b087-4b1082f06cfb. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6b8bc7a3-0e5c-4cc2-a7a5-afaf0a65dba5 req-44bbbb18-17f2-40b5-833d-76ef2a186403 service nova] Acquiring lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6b8bc7a3-0e5c-4cc2-a7a5-afaf0a65dba5 req-44bbbb18-17f2-40b5-833d-76ef2a186403 service nova] Acquired lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.network.neutron [req-6b8bc7a3-0e5c-4cc2-a7a5-afaf0a65dba5 req-44bbbb18-17f2-40b5-833d-76ef2a186403 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Refreshing network info cache for port bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "49467859-954f-498d-b520-587c7f38effc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "49467859-954f-498d-b520-587c7f38effc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:26 user nova-compute[72019]: INFO nova.compute.manager [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Detaching volume fcdfe359-4681-4ebf-847d-85edfd26edc0
Apr 14 13:26:26 user nova-compute[72019]: INFO nova.virt.block_device [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Attempting to driver detach volume fcdfe359-4681-4ebf-847d-85edfd26edc0 from mountpoint /dev/vdb
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Attempting to detach device vdb from instance 49467859-954f-498d-b520-587c7f38effc from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:26:26 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:26:26 user nova-compute[72019]:   <source dev="/dev/sde"/>
Apr 14 13:26:26 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:26:26 user nova-compute[72019]:   <serial>fcdfe359-4681-4ebf-847d-85edfd26edc0</serial>
Apr 14 13:26:26 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 13:26:26 user nova-compute[72019]: </disk>
Apr 14 13:26:26 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:26:26 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Successfully detached device vdb from instance 49467859-954f-498d-b520-587c7f38effc from the persistent domain config.
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49467859-954f-498d-b520-587c7f38effc from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:26:26 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:26:26 user nova-compute[72019]:   <source dev="/dev/sde"/>
Apr 14 13:26:26 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:26:26 user nova-compute[72019]:   <serial>fcdfe359-4681-4ebf-847d-85edfd26edc0</serial>
Apr 14 13:26:26 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 13:26:26 user nova-compute[72019]: </disk>
Apr 14 13:26:26 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:26:26 user nova-compute[72019]: WARNING nova.compute.manager [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state active and task_state resize_finish.
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:26:26 user nova-compute[72019]: WARNING nova.compute.manager [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state active and task_state resize_finish.
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.network.neutron [req-6b8bc7a3-0e5c-4cc2-a7a5-afaf0a65dba5 req-44bbbb18-17f2-40b5-833d-76ef2a186403 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Updated VIF entry in instance network info cache for port bcff28e3-32d8-4f26-b087-4b1082f06cfb. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG nova.network.neutron [req-6b8bc7a3-0e5c-4cc2-a7a5-afaf0a65dba5 req-44bbbb18-17f2-40b5-833d-76ef2a186403 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Updating instance_info_cache with network_info: [{"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:26:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6b8bc7a3-0e5c-4cc2-a7a5-afaf0a65dba5 req-44bbbb18-17f2-40b5-833d-76ef2a186403 service nova] Releasing lock "refresh_cache-49467859-954f-498d-b520-587c7f38effc" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478787.1517456, 49467859-954f-498d-b520-587c7f38effc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49467859-954f-498d-b520-587c7f38effc {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:26:27 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Successfully detached device vdb from instance 49467859-954f-498d-b520-587c7f38effc from the live domain config.
Apr 14 13:26:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVBKAhTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:26:27 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efa8265-ee7c-4676-9050-2abfa573f603]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:26:27 user nova-compute[72019]: No targets found.
Apr 14 13:26:27 user nova-compute[72019]: iSNS:
Apr 14 13:26:27 user nova-compute[72019]: No targets found.
Apr 14 13:26:27 user nova-compute[72019]: STATIC:
Apr 14 13:26:27 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc
Apr 14 13:26:27 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:27 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:27 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0
Apr 14 13:26:27 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:27 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:27 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:26:27 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:27 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:27 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b
Apr 14 13:26:27 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:27 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:27 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29
Apr 14 13:26:27 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:27 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:27 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460
Apr 14 13:26:27 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:27 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:27 user nova-compute[72019]: FIRMWARE:
Apr 14 13:26:27 user nova-compute[72019]: No targets found.
Apr 14 13:26:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:26:27 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:26:27 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8ac997-a4aa-4ad4-bd13-67ced956c9e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3d35c7-33db-458d-85b7-a9a40afdfd3d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:27 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:27 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:27 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:27 user nova-compute[72019]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)
Apr 14 13:26:27 user nova-compute[72019]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:26:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:27 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:27 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:27 user nova-compute[72019]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 (non-flash)
Apr 14 13:26:27 user nova-compute[72019]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)
Apr 14 13:26:27 user nova-compute[72019]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:26:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f746478fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0'): ({'sde'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Removing single pathed devices sde {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db0c98c-941a-44c1-ab4d-b7aaca9e612b]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0f651e-8d53-443a-bb91-d9ca8f12d368]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Flushing IO for device /dev/sde {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81372d9-fd38-4095-91f9-6786790b5e0c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[872781c9-60bb-43a3-a1d2-caa190c367bf]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5606e650-3e79-48fa-8ecc-d9e0419bb056]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb3777c-c9ca-48f4-9707-d0850df3d616]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260]
Apr 14 13:26:27 user nova-compute[72019]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0, portal: 172.16.0.220,3260] successful.
Apr 14 13:26:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcdfe359-4681-4ebf-847d-85edfd26edc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b8faa3-7def-4de2-9e84-8b825312ec0c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] <== disconnect_volume: return (371ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for 6e646c88-579e-4ea1-b987-da1c7194a064 due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478787.8192704, 6e646c88-579e-4ea1-b987-da1c7194a064 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:26:27 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] VM Resumed (Lifecycle Event)
Apr 14 13:26:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:26:27 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance running successfully.
Apr 14 13:26:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Failed to set time: agent not configured {{(pid=72019) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] finish_migration finished successfully. {{(pid=72019) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:26:27 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 13:26:27 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478787.8206697, 6e646c88-579e-4ea1-b987-da1c7194a064 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:26:27 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] VM Started (Lifecycle Event)
Apr 14 13:26:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:26:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:26:28 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 13:26:28 user nova-compute[72019]: DEBUG nova.objects.instance [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'flavor' on Instance uuid 49467859-954f-498d-b520-587c7f38effc {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:26:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "49467859-954f-498d-b520-587c7f38effc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.947s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:31 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:26:31 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:26:31 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:26:31 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:26:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:26:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:26:31 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Updating instance_info_cache with network_info: [{"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:26:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:26:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:26:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:36 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:26:36 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:37 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:26:37 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7536MB free_disk=26.091323852539062GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Applying migration context for instance 6e646c88-579e-4ea1-b987-da1c7194a064 as it has an incoming, in-progress migration 5169f869-26b1-4d9b-b726-ebf138fd4b74. Migration status is finished {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 13:26:37 user nova-compute[72019]: INFO nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating resource usage from migration 5169f869-26b1-4d9b-b726-ebf138fd4b74
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 775293fc-1773-407d-bf49-fccfe849f440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 49467859-954f-498d-b520-587c7f38effc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Migration 5169f869-26b1-4d9b-b726-ebf138fd4b74 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=2112MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:26:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.653s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-afc8f025-08d7-4e95-98e2-78a04e7eff9b req-b1cb4562-0a16-4f19-be3c-af8104f12e86 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-changed-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-afc8f025-08d7-4e95-98e2-78a04e7eff9b req-b1cb4562-0a16-4f19-be3c-af8104f12e86 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Refreshing instance network info cache due to event network-changed-aef4cd67-4e33-4456-b7d9-195955db1cdc. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:26:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-afc8f025-08d7-4e95-98e2-78a04e7eff9b req-b1cb4562-0a16-4f19-be3c-af8104f12e86 service nova] Acquiring lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:26:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-afc8f025-08d7-4e95-98e2-78a04e7eff9b req-b1cb4562-0a16-4f19-be3c-af8104f12e86 service nova] Acquired lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:26:49 user nova-compute[72019]: DEBUG nova.network.neutron [req-afc8f025-08d7-4e95-98e2-78a04e7eff9b req-b1cb4562-0a16-4f19-be3c-af8104f12e86 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Refreshing network info cache for port aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:26:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "775293fc-1773-407d-bf49-fccfe849f440" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:49 user nova-compute[72019]: INFO nova.compute.manager [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Detaching volume 7f85a79b-307a-48e6-81fb-01b78bf092dc
Apr 14 13:26:49 user nova-compute[72019]: INFO nova.virt.block_device [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Attempting to driver detach volume 7f85a79b-307a-48e6-81fb-01b78bf092dc from mountpoint /dev/vdb
Apr 14 13:26:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Attempting to detach device vdb from instance 775293fc-1773-407d-bf49-fccfe849f440 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:26:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:26:49 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:26:49 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:26:49 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:26:49 user nova-compute[72019]:   <serial>7f85a79b-307a-48e6-81fb-01b78bf092dc</serial>
Apr 14 13:26:49 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:26:49 user nova-compute[72019]: </disk>
Apr 14 13:26:49 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:26:49 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Successfully detached device vdb from instance 775293fc-1773-407d-bf49-fccfe849f440 from the persistent domain config.
Apr 14 13:26:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 775293fc-1773-407d-bf49-fccfe849f440 from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:26:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:26:49 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:26:49 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:26:49 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:26:49 user nova-compute[72019]:   <serial>7f85a79b-307a-48e6-81fb-01b78bf092dc</serial>
Apr 14 13:26:49 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:26:49 user nova-compute[72019]: </disk>
Apr 14 13:26:49 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:26:49 user nova-compute[72019]: DEBUG nova.network.neutron [req-afc8f025-08d7-4e95-98e2-78a04e7eff9b req-b1cb4562-0a16-4f19-be3c-af8104f12e86 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Updated VIF entry in instance network info cache for port aef4cd67-4e33-4456-b7d9-195955db1cdc. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:26:49 user nova-compute[72019]: DEBUG nova.network.neutron [req-afc8f025-08d7-4e95-98e2-78a04e7eff9b req-b1cb4562-0a16-4f19-be3c-af8104f12e86 service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Updating instance_info_cache with network_info: [{"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:26:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-afc8f025-08d7-4e95-98e2-78a04e7eff9b req-b1cb4562-0a16-4f19-be3c-af8104f12e86 service nova] Releasing lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478810.1521547, 775293fc-1773-407d-bf49-fccfe849f440 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:26:50 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Successfully detached device vdb from instance 775293fc-1773-407d-bf49-fccfe849f440 from the live domain config.
Apr 14 13:26:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUacntEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:26:50 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5934115e-e5d4-4bf1-8727-04721621ba4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:26:50 user nova-compute[72019]: No targets found.
Apr 14 13:26:50 user nova-compute[72019]: iSNS:
Apr 14 13:26:50 user nova-compute[72019]: No targets found.
Apr 14 13:26:50 user nova-compute[72019]: STATIC:
Apr 14 13:26:50 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc
Apr 14 13:26:50 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:50 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:50 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:26:50 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:50 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:50 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b
Apr 14 13:26:50 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:50 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:50 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29
Apr 14 13:26:50 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:50 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:50 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460
Apr 14 13:26:50 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:26:50 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:26:50 user nova-compute[72019]: FIRMWARE:
Apr 14 13:26:50 user nova-compute[72019]: No targets found.
Apr 14 13:26:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:26:50 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:26:50 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e20be65-9604-41bc-8900-77d1fba46e52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb1d499-1522-4009-9331-0eaa4e831796]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:50 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:50 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:50 user nova-compute[72019]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)
Apr 14 13:26:50 user nova-compute[72019]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:26:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:26:50 user nova-compute[72019]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc (non-flash)
Apr 14 13:26:50 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:26:50 user nova-compute[72019]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)
Apr 14 13:26:50 user nova-compute[72019]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:26:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f746478fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc'): ({'sdb'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Removing single pathed devices sdb {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9b39b1-aae4-4d73-a2b8-ae29fe78c8ed]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a5b975-5db5-4aab-bdc5-7cb817feb13b]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flushing IO for device /dev/sdb {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce7b03f-7718-4b4a-82a6-e1a88b42a898]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[285aff33-d8c1-4ace-babb-44eb68306107]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e204611-60af-405c-9d90-4a93cf348af6]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG nova.compute.manager [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90e5f41-239f-459b-85cf-42a5e6dffdc4]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc, portal: 172.16.0.220,3260]
Apr 14 13:26:50 user nova-compute[72019]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc, portal: 172.16.0.220,3260] successful.
Apr 14 13:26:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f85a79b-307a-48e6-81fb-01b78bf092dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7bc5cd-c7e3-47f5-a7ee-f3bf09484ea4]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] <== disconnect_volume: return (363ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:26:50 user nova-compute[72019]: INFO nova.compute.claims [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Claim successful on node user
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-53e16d5c-6c13-417b-8eef-c648af7e1a59 req-ccdf53f7-2a77-4823-a0ae-8fb3229248ed service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-changed-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-53e16d5c-6c13-417b-8eef-c648af7e1a59 req-ccdf53f7-2a77-4823-a0ae-8fb3229248ed service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Refreshing instance network info cache due to event network-changed-aef4cd67-4e33-4456-b7d9-195955db1cdc. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-53e16d5c-6c13-417b-8eef-c648af7e1a59 req-ccdf53f7-2a77-4823-a0ae-8fb3229248ed service nova] Acquiring lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-53e16d5c-6c13-417b-8eef-c648af7e1a59 req-ccdf53f7-2a77-4823-a0ae-8fb3229248ed service nova] Acquired lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.network.neutron [req-53e16d5c-6c13-417b-8eef-c648af7e1a59 req-ccdf53f7-2a77-4823-a0ae-8fb3229248ed service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Refreshing network info cache for port aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.network.neutron [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:26:51 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:26:51 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Creating image(s)
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "/opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "/opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "/opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.policy [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd53a298063a346ec9b41110051e689c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6e06c2dbf479697403fee2b1b72e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'flavor' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "775293fc-1773-407d-bf49-fccfe849f440" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.038s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk 1073741824" returned: 0 in 0.051s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.144s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.network.neutron [req-53e16d5c-6c13-417b-8eef-c648af7e1a59 req-ccdf53f7-2a77-4823-a0ae-8fb3229248ed service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Updated VIF entry in instance network info cache for port aef4cd67-4e33-4456-b7d9-195955db1cdc. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.network.neutron [req-53e16d5c-6c13-417b-8eef-c648af7e1a59 req-ccdf53f7-2a77-4823-a0ae-8fb3229248ed service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Updating instance_info_cache with network_info: [{"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-53e16d5c-6c13-417b-8eef-c648af7e1a59 req-ccdf53f7-2a77-4823-a0ae-8fb3229248ed service nova] Releasing lock "refresh_cache-775293fc-1773-407d-bf49-fccfe849f440" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Cannot resize image /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.objects.instance [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lazy-loading 'migration_context' on Instance uuid 31781f5a-460a-41e3-bdcf-9cb20f050ba3 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Ensure instance console log exists: /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:52 user nova-compute[72019]: DEBUG nova.network.neutron [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Successfully created port: c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.network.neutron [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Successfully updated port: c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquired lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.network.neutron [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-6db92400-7830-4b76-833f-09132e9be3e7 req-82935c1f-35ea-42d4-8ec2-c92c0f6406ca service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Received event network-changed-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-6db92400-7830-4b76-833f-09132e9be3e7 req-82935c1f-35ea-42d4-8ec2-c92c0f6406ca service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Refreshing instance network info cache due to event network-changed-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6db92400-7830-4b76-833f-09132e9be3e7 req-82935c1f-35ea-42d4-8ec2-c92c0f6406ca service nova] Acquiring lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.network.neutron [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.network.neutron [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Updating instance_info_cache with network_info: [{"id": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "address": "fa:16:3e:af:84:dd", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55e9150-07", "ovs_interfaceid": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Releasing lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Instance network_info: |[{"id": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "address": "fa:16:3e:af:84:dd", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55e9150-07", "ovs_interfaceid": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6db92400-7830-4b76-833f-09132e9be3e7 req-82935c1f-35ea-42d4-8ec2-c92c0f6406ca service nova] Acquired lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.network.neutron [req-6db92400-7830-4b76-833f-09132e9be3e7 req-82935c1f-35ea-42d4-8ec2-c92c0f6406ca service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Refreshing network info cache for port c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Start _get_guest_xml network_info=[{"id": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "address": "fa:16:3e:af:84:dd", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55e9150-07", "ovs_interfaceid": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:53 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:26:53 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1255991021',display_name='tempest-TestStampPattern-server-1255991021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1255991021',id=37,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIm4aARBA4lAX/hfwMD4oBZFv2cTXlcgSngjcTEDIv9RAHTvjbNkAIIQYYwrK0JxNUWLzReMonMtMkMBWIgzI882038PhtWRli7iqrN9dwPmOnFtL9wStfKPVLf4sjHM0w==',key_name='tempest-TestStampPattern-924006334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdd6e06c2dbf479697403fee2b1b72e2',ramdisk_id='',reservation_id='r-2dmaqv87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1896841208',owner_user_name='tempest-TestStampPattern-1896841208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:26:51Z,user_data=None,user_id='d53a298063a346ec9b41110051e689c8',uuid=31781f5a-460a-41e3-bdcf-9cb20f050ba3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "address": "fa:16:3e:af:84:dd", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55e9150-07", "ovs_interfaceid": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Converting VIF {"id": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "address": "fa:16:3e:af:84:dd", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55e9150-07", "ovs_interfaceid": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:84:dd,bridge_name='br-int',has_traffic_filtering=True,id=c55e9150-0706-4fa7-9c0c-e94b7aefc8eb,network=Network(09bf32cb-4684-4c95-a44c-6924d228b6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc55e9150-07') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.objects.instance [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lazy-loading 'pci_devices' on Instance uuid 31781f5a-460a-41e3-bdcf-9cb20f050ba3 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:26:53 user nova-compute[72019]:   <uuid>31781f5a-460a-41e3-bdcf-9cb20f050ba3</uuid>
Apr 14 13:26:53 user nova-compute[72019]:   <name>instance-00000025</name>
Apr 14 13:26:53 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:26:53 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:26:53 user nova-compute[72019]:   <metadata>
Apr 14 13:26:53 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:26:53 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:26:53 user nova-compute[72019]:       <nova:name>tempest-TestStampPattern-server-1255991021</nova:name>
Apr 14 13:26:53 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:26:53</nova:creationTime>
Apr 14 13:26:53 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:26:53 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:26:53 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:26:53 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:26:53 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:26:53 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:26:53 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:26:53 user nova-compute[72019]:       <nova:owner>
Apr 14 13:26:53 user nova-compute[72019]:         <nova:user uuid="d53a298063a346ec9b41110051e689c8">tempest-TestStampPattern-1896841208-project-member</nova:user>
Apr 14 13:26:53 user nova-compute[72019]:         <nova:project uuid="fdd6e06c2dbf479697403fee2b1b72e2">tempest-TestStampPattern-1896841208</nova:project>
Apr 14 13:26:53 user nova-compute[72019]:       </nova:owner>
Apr 14 13:26:53 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:26:53 user nova-compute[72019]:       <nova:ports>
Apr 14 13:26:53 user nova-compute[72019]:         <nova:port uuid="c55e9150-0706-4fa7-9c0c-e94b7aefc8eb">
Apr 14 13:26:53 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 13:26:53 user nova-compute[72019]:         </nova:port>
Apr 14 13:26:53 user nova-compute[72019]:       </nova:ports>
Apr 14 13:26:53 user nova-compute[72019]:     </nova:instance>
Apr 14 13:26:53 user nova-compute[72019]:   </metadata>
Apr 14 13:26:53 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:26:53 user nova-compute[72019]:     <system>
Apr 14 13:26:53 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:26:53 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:26:53 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:26:53 user nova-compute[72019]:       <entry name="serial">31781f5a-460a-41e3-bdcf-9cb20f050ba3</entry>
Apr 14 13:26:53 user nova-compute[72019]:       <entry name="uuid">31781f5a-460a-41e3-bdcf-9cb20f050ba3</entry>
Apr 14 13:26:53 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:26:53 user nova-compute[72019]:     </system>
Apr 14 13:26:53 user nova-compute[72019]:   </sysinfo>
Apr 14 13:26:53 user nova-compute[72019]:   <os>
Apr 14 13:26:53 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:26:53 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:26:53 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:26:53 user nova-compute[72019]:   </os>
Apr 14 13:26:53 user nova-compute[72019]:   <features>
Apr 14 13:26:53 user nova-compute[72019]:     <acpi/>
Apr 14 13:26:53 user nova-compute[72019]:     <apic/>
Apr 14 13:26:53 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:26:53 user nova-compute[72019]:   </features>
Apr 14 13:26:53 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:26:53 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:26:53 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:26:53 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:26:53 user nova-compute[72019]:   </clock>
Apr 14 13:26:53 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:26:53 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:26:53 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:26:53 user nova-compute[72019]:   </cpu>
Apr 14 13:26:53 user nova-compute[72019]:   <devices>
Apr 14 13:26:53 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:26:53 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:26:53 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk"/>
Apr 14 13:26:53 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:26:53 user nova-compute[72019]:     </disk>
Apr 14 13:26:53 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:26:53 user nova-compute[72019]:       <mac address="fa:16:3e:af:84:dd"/>
Apr 14 13:26:53 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:26:53 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:26:53 user nova-compute[72019]:       <target dev="tapc55e9150-07"/>
Apr 14 13:26:53 user nova-compute[72019]:     </interface>
Apr 14 13:26:53 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:26:53 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/console.log" append="off"/>
Apr 14 13:26:53 user nova-compute[72019]:     </serial>
Apr 14 13:26:53 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:26:53 user nova-compute[72019]:     <video>
Apr 14 13:26:53 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:26:53 user nova-compute[72019]:     </video>
Apr 14 13:26:53 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:26:53 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:26:53 user nova-compute[72019]:     </rng>
Apr 14 13:26:53 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:26:53 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:26:53 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:26:53 user nova-compute[72019]:     </memballoon>
Apr 14 13:26:53 user nova-compute[72019]:   </devices>
Apr 14 13:26:53 user nova-compute[72019]: </domain>
Apr 14 13:26:53 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1255991021',display_name='tempest-TestStampPattern-server-1255991021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1255991021',id=37,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIm4aARBA4lAX/hfwMD4oBZFv2cTXlcgSngjcTEDIv9RAHTvjbNkAIIQYYwrK0JxNUWLzReMonMtMkMBWIgzI882038PhtWRli7iqrN9dwPmOnFtL9wStfKPVLf4sjHM0w==',key_name='tempest-TestStampPattern-924006334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdd6e06c2dbf479697403fee2b1b72e2',ramdisk_id='',reservation_id='r-2dmaqv87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1896841208',owner_user_name='tempest-TestStampPattern-1896841208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:26:51Z,user_data=None,user_id='d53a298063a346ec9b41110051e689c8',uuid=31781f5a-460a-41e3-bdcf-9cb20f050ba3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "address": "fa:16:3e:af:84:dd", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55e9150-07", "ovs_interfaceid": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Converting VIF {"id": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "address": "fa:16:3e:af:84:dd", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55e9150-07", "ovs_interfaceid": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:84:dd,bridge_name='br-int',has_traffic_filtering=True,id=c55e9150-0706-4fa7-9c0c-e94b7aefc8eb,network=Network(09bf32cb-4684-4c95-a44c-6924d228b6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc55e9150-07') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG os_vif [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:84:dd,bridge_name='br-int',has_traffic_filtering=True,id=c55e9150-0706-4fa7-9c0c-e94b7aefc8eb,network=Network(09bf32cb-4684-4c95-a44c-6924d228b6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc55e9150-07') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc55e9150-07, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc55e9150-07, col_values=(('external_ids', {'iface-id': 'c55e9150-0706-4fa7-9c0c-e94b7aefc8eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:84:dd', 'vm-uuid': '31781f5a-460a-41e3-bdcf-9cb20f050ba3'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:26:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:53 user nova-compute[72019]: INFO os_vif [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:84:dd,bridge_name='br-int',has_traffic_filtering=True,id=c55e9150-0706-4fa7-9c0c-e94b7aefc8eb,network=Network(09bf32cb-4684-4c95-a44c-6924d228b6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc55e9150-07')
Apr 14 13:26:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:26:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] No VIF found with MAC fa:16:3e:af:84:dd, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:26:54 user nova-compute[72019]: DEBUG nova.network.neutron [req-6db92400-7830-4b76-833f-09132e9be3e7 req-82935c1f-35ea-42d4-8ec2-c92c0f6406ca service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Updated VIF entry in instance network info cache for port c55e9150-0706-4fa7-9c0c-e94b7aefc8eb. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:26:54 user nova-compute[72019]: DEBUG nova.network.neutron [req-6db92400-7830-4b76-833f-09132e9be3e7 req-82935c1f-35ea-42d4-8ec2-c92c0f6406ca service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Updating instance_info_cache with network_info: [{"id": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "address": "fa:16:3e:af:84:dd", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55e9150-07", "ovs_interfaceid": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:26:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6db92400-7830-4b76-833f-09132e9be3e7 req-82935c1f-35ea-42d4-8ec2-c92c0f6406ca service nova] Releasing lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:26:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:55 user nova-compute[72019]: DEBUG nova.compute.manager [req-aa38dd02-e04d-4f37-a408-b5882e9e1da9 req-44ea2058-ec76-4a29-ad22-322ab04052a9 service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Received event network-vif-plugged-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aa38dd02-e04d-4f37-a408-b5882e9e1da9 req-44ea2058-ec76-4a29-ad22-322ab04052a9 service nova] Acquiring lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aa38dd02-e04d-4f37-a408-b5882e9e1da9 req-44ea2058-ec76-4a29-ad22-322ab04052a9 service nova] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aa38dd02-e04d-4f37-a408-b5882e9e1da9 req-44ea2058-ec76-4a29-ad22-322ab04052a9 service nova] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:55 user nova-compute[72019]: DEBUG nova.compute.manager [req-aa38dd02-e04d-4f37-a408-b5882e9e1da9 req-44ea2058-ec76-4a29-ad22-322ab04052a9 service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] No waiting events found dispatching network-vif-plugged-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:26:55 user nova-compute[72019]: WARNING nova.compute.manager [req-aa38dd02-e04d-4f37-a408-b5882e9e1da9 req-44ea2058-ec76-4a29-ad22-322ab04052a9 service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Received unexpected event network-vif-plugged-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb for instance with vm_state building and task_state spawning.
Apr 14 13:26:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478817.717333, 31781f5a-460a-41e3-bdcf-9cb20f050ba3 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:26:57 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] VM Resumed (Lifecycle Event)
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:26:57 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Instance spawned successfully.
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:26:57 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478817.7191896, 31781f5a-460a-41e3-bdcf-9cb20f050ba3 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:26:57 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] VM Started (Lifecycle Event)
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:26:57 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:26:57 user nova-compute[72019]: INFO nova.compute.manager [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Took 6.50 seconds to spawn the instance on the hypervisor.
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:26:57 user nova-compute[72019]: INFO nova.compute.manager [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Took 7.38 seconds to build instance.
Apr 14 13:26:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.486s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-288a3075-981e-4e02-88d2-0a52a1d60481 req-e8a5faea-13bc-4826-bd35-43a2a29b35db service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Received event network-vif-plugged-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-288a3075-981e-4e02-88d2-0a52a1d60481 req-e8a5faea-13bc-4826-bd35-43a2a29b35db service nova] Acquiring lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-288a3075-981e-4e02-88d2-0a52a1d60481 req-e8a5faea-13bc-4826-bd35-43a2a29b35db service nova] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-288a3075-981e-4e02-88d2-0a52a1d60481 req-e8a5faea-13bc-4826-bd35-43a2a29b35db service nova] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:26:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-288a3075-981e-4e02-88d2-0a52a1d60481 req-e8a5faea-13bc-4826-bd35-43a2a29b35db service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] No waiting events found dispatching network-vif-plugged-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:26:57 user nova-compute[72019]: WARNING nova.compute.manager [req-288a3075-981e-4e02-88d2-0a52a1d60481 req-e8a5faea-13bc-4826-bd35-43a2a29b35db service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Received unexpected event network-vif-plugged-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb for instance with vm_state active and task_state None.
Apr 14 13:26:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-04fdd132-26c6-4532-8503-e3095f4172c7 req-4a5a6cab-6be5-4eab-a2eb-0af33c917540 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received event network-changed-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:27:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-04fdd132-26c6-4532-8503-e3095f4172c7 req-4a5a6cab-6be5-4eab-a2eb-0af33c917540 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Refreshing instance network info cache due to event network-changed-3cf56142-3eb9-481f-9e81-b839a2106ab3. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:27:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-04fdd132-26c6-4532-8503-e3095f4172c7 req-4a5a6cab-6be5-4eab-a2eb-0af33c917540 service nova] Acquiring lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:27:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-04fdd132-26c6-4532-8503-e3095f4172c7 req-4a5a6cab-6be5-4eab-a2eb-0af33c917540 service nova] Acquired lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:27:00 user nova-compute[72019]: DEBUG nova.network.neutron [req-04fdd132-26c6-4532-8503-e3095f4172c7 req-4a5a6cab-6be5-4eab-a2eb-0af33c917540 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Refreshing network info cache for port 3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:27:01 user nova-compute[72019]: DEBUG nova.network.neutron [req-04fdd132-26c6-4532-8503-e3095f4172c7 req-4a5a6cab-6be5-4eab-a2eb-0af33c917540 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Updated VIF entry in instance network info cache for port 3cf56142-3eb9-481f-9e81-b839a2106ab3. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:27:01 user nova-compute[72019]: DEBUG nova.network.neutron [req-04fdd132-26c6-4532-8503-e3095f4172c7 req-4a5a6cab-6be5-4eab-a2eb-0af33c917540 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Updating instance_info_cache with network_info: [{"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:27:01 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-04fdd132-26c6-4532-8503-e3095f4172c7 req-4a5a6cab-6be5-4eab-a2eb-0af33c917540 service nova] Releasing lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:27:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:04 user nova-compute[72019]: INFO nova.compute.manager [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Shelving
Apr 14 13:27:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:04 user nova-compute[72019]: DEBUG nova.compute.manager [req-0396bad6-2cb4-40a7-ae8e-0270e4cd2435 req-56c3d87a-37a1-43d4-865b-987c639a691f service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received event network-vif-unplugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:27:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0396bad6-2cb4-40a7-ae8e-0270e4cd2435 req-56c3d87a-37a1-43d4-865b-987c639a691f service nova] Acquiring lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0396bad6-2cb4-40a7-ae8e-0270e4cd2435 req-56c3d87a-37a1-43d4-865b-987c639a691f service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0396bad6-2cb4-40a7-ae8e-0270e4cd2435 req-56c3d87a-37a1-43d4-865b-987c639a691f service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:04 user nova-compute[72019]: DEBUG nova.compute.manager [req-0396bad6-2cb4-40a7-ae8e-0270e4cd2435 req-56c3d87a-37a1-43d4-865b-987c639a691f service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] No waiting events found dispatching network-vif-unplugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:27:04 user nova-compute[72019]: WARNING nova.compute.manager [req-0396bad6-2cb4-40a7-ae8e-0270e4cd2435 req-56c3d87a-37a1-43d4-865b-987c639a691f service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received unexpected event network-vif-unplugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance with vm_state active and task_state shelving.
Apr 14 13:27:05 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Instance destroyed successfully.
Apr 14 13:27:05 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Beginning cold snapshot process
Apr 14 13:27:05 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:27:05 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk /opt/stack/data/nova/instances/snapshots/tmpsomq85r6/40dd66d5e0024088bf412fa8eefde459 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk /opt/stack/data/nova/instances/snapshots/tmpsomq85r6/40dd66d5e0024088bf412fa8eefde459" returned: 0 in 0.576s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:06 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Snapshot extracted, beginning image upload
Apr 14 13:27:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-ea6a4849-cf7c-4602-b9d7-031f328862fe req-25b6fb1c-90ec-4aa3-9c26-36ee42ef81da service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received event network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:27:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ea6a4849-cf7c-4602-b9d7-031f328862fe req-25b6fb1c-90ec-4aa3-9c26-36ee42ef81da service nova] Acquiring lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ea6a4849-cf7c-4602-b9d7-031f328862fe req-25b6fb1c-90ec-4aa3-9c26-36ee42ef81da service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ea6a4849-cf7c-4602-b9d7-031f328862fe req-25b6fb1c-90ec-4aa3-9c26-36ee42ef81da service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-ea6a4849-cf7c-4602-b9d7-031f328862fe req-25b6fb1c-90ec-4aa3-9c26-36ee42ef81da service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] No waiting events found dispatching network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:27:07 user nova-compute[72019]: WARNING nova.compute.manager [req-ea6a4849-cf7c-4602-b9d7-031f328862fe req-25b6fb1c-90ec-4aa3-9c26-36ee42ef81da service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received unexpected event network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 13:27:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:08 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Snapshot image upload complete
Apr 14 13:27:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:27:08 user nova-compute[72019]: INFO nova.compute.manager [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Shelve offloading
Apr 14 13:27:08 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Instance destroyed successfully.
Apr 14 13:27:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:27:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:27:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquired lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:27:08 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:27:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Updating instance_info_cache with network_info: [{"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Releasing lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:27:09 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Instance destroyed successfully.
Apr 14 13:27:09 user nova-compute[72019]: DEBUG nova.objects.instance [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'resources' on Instance uuid f7df0d0b-535b-4a60-a050-ddd6449e3c4d {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1289054872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1289054872',id=34,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM58epGqhtKxGXJ/+xFhEOxUulN613XjttUVnaW18pLMGQ2SIMhHBKaAkyjthPjHjJkakSAYkqQ670pGkRR5B7mIl8EE7DrTXrHs+Sy5Z42MrNXXIqNpGIAl9c8To2l2Sg==',key_name='tempest-keypair-321023180',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:25:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8f0fee50983a4e31b1689dc77b1c4db1',ramdisk_id='',reservation_id='r-vz8bjy3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1344633518',owner_user_name='tempest-AttachVolumeShelveTestJSON-1344633518-project-member',shelved_at='2023-04-14T13:27:08.558881',shelved_host='user',shelved_image_id='4f68a37c-6f0b-4856-8726-572c25db2b8d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:27:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04370605aec40a0a53a080c1e8bf8a8',uuid=f7df0d0b-535b-4a60-a050-ddd6449e3c4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converting VIF {"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ff:1f,bridge_name='br-int',has_traffic_filtering=True,id=3cf56142-3eb9-481f-9e81-b839a2106ab3,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf56142-3e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG os_vif [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ff:1f,bridge_name='br-int',has_traffic_filtering=True,id=3cf56142-3eb9-481f-9e81-b839a2106ab3,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf56142-3e') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cf56142-3e, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-5c933623-18fc-4a35-97fc-9c768553d3b8 req-59af83c2-233f-4a4c-abeb-0c460815e4db service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received event network-changed-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-5c933623-18fc-4a35-97fc-9c768553d3b8 req-59af83c2-233f-4a4c-abeb-0c460815e4db service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Refreshing instance network info cache due to event network-changed-3cf56142-3eb9-481f-9e81-b839a2106ab3. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5c933623-18fc-4a35-97fc-9c768553d3b8 req-59af83c2-233f-4a4c-abeb-0c460815e4db service nova] Acquiring lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5c933623-18fc-4a35-97fc-9c768553d3b8 req-59af83c2-233f-4a4c-abeb-0c460815e4db service nova] Acquired lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:27:09 user nova-compute[72019]: DEBUG nova.network.neutron [req-5c933623-18fc-4a35-97fc-9c768553d3b8 req-59af83c2-233f-4a4c-abeb-0c460815e4db service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Refreshing network info cache for port 3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:27:09 user nova-compute[72019]: INFO os_vif [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ff:1f,bridge_name='br-int',has_traffic_filtering=True,id=3cf56142-3eb9-481f-9e81-b839a2106ab3,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf56142-3e')
Apr 14 13:27:09 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Deleting instance files /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d_del
Apr 14 13:27:09 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Deletion of /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d_del complete
Apr 14 13:27:10 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Deleted allocations for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d
Apr 14 13:27:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:10 user nova-compute[72019]: DEBUG nova.objects.instance [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'numa_topology' on Instance uuid f7df0d0b-535b-4a60-a050-ddd6449e3c4d {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:27:10 user nova-compute[72019]: DEBUG nova.network.neutron [req-5c933623-18fc-4a35-97fc-9c768553d3b8 req-59af83c2-233f-4a4c-abeb-0c460815e4db service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Updated VIF entry in instance network info cache for port 3cf56142-3eb9-481f-9e81-b839a2106ab3. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:27:10 user nova-compute[72019]: DEBUG nova.network.neutron [req-5c933623-18fc-4a35-97fc-9c768553d3b8 req-59af83c2-233f-4a4c-abeb-0c460815e4db service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Updating instance_info_cache with network_info: [{"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3cf56142-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:27:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5c933623-18fc-4a35-97fc-9c768553d3b8 req-59af83c2-233f-4a4c-abeb-0c460815e4db service nova] Releasing lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:27:10 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:27:10 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:27:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.121s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:27:12 user nova-compute[72019]: INFO nova.compute.manager [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] instance snapshotting
Apr 14 13:27:12 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Beginning live snapshot process
Apr 14 13:27:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json -f qcow2 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json -f qcow2 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.147s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuotoen66/616638a5faa44fe9822f33d1fc05e840.delta 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuotoen66/616638a5faa44fe9822f33d1fc05e840.delta 1073741824" returned: 0 in 0.228s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:13 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 13:27:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:27:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:27:14 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 13:27:14 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:27:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuotoen66/616638a5faa44fe9822f33d1fc05e840.delta /opt/stack/data/nova/instances/snapshots/tmpuotoen66/616638a5faa44fe9822f33d1fc05e840 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuotoen66/616638a5faa44fe9822f33d1fc05e840.delta /opt/stack/data/nova/instances/snapshots/tmpuotoen66/616638a5faa44fe9822f33d1fc05e840" returned: 0 in 0.590s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:15 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Snapshot extracted, beginning image upload
Apr 14 13:27:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:17 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Snapshot image upload complete
Apr 14 13:27:17 user nova-compute[72019]: INFO nova.compute.manager [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Took 5.27 seconds to snapshot the instance on the hypervisor.
Apr 14 13:27:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:20 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478825.4243371, f7df0d0b-535b-4a60-a050-ddd6449e3c4d => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:27:20 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] VM Stopped (Lifecycle Event)
Apr 14 13:27:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-49e4edf1-9800-456f-9c08-bf04e945140f None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "49467859-954f-498d-b520-587c7f38effc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "49467859-954f-498d-b520-587c7f38effc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "49467859-954f-498d-b520-587c7f38effc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "49467859-954f-498d-b520-587c7f38effc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "49467859-954f-498d-b520-587c7f38effc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:23 user nova-compute[72019]: INFO nova.compute.manager [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Terminating instance
Apr 14 13:27:23 user nova-compute[72019]: DEBUG nova.compute.manager [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-d51a4a48-e973-4b09-a66a-3c0f594039b8 req-2052a5ce-2996-428a-a8a6-103c4529172a service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-vif-unplugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d51a4a48-e973-4b09-a66a-3c0f594039b8 req-2052a5ce-2996-428a-a8a6-103c4529172a service nova] Acquiring lock "49467859-954f-498d-b520-587c7f38effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d51a4a48-e973-4b09-a66a-3c0f594039b8 req-2052a5ce-2996-428a-a8a6-103c4529172a service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d51a4a48-e973-4b09-a66a-3c0f594039b8 req-2052a5ce-2996-428a-a8a6-103c4529172a service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-d51a4a48-e973-4b09-a66a-3c0f594039b8 req-2052a5ce-2996-428a-a8a6-103c4529172a service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] No waiting events found dispatching network-vif-unplugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-d51a4a48-e973-4b09-a66a-3c0f594039b8 req-2052a5ce-2996-428a-a8a6-103c4529172a service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-vif-unplugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:27:23 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 49467859-954f-498d-b520-587c7f38effc] Instance destroyed successfully.
Apr 14 13:27:23 user nova-compute[72019]: DEBUG nova.objects.instance [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'resources' on Instance uuid 49467859-954f-498d-b520-587c7f38effc {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-672930101',display_name='tempest-TestMinimumBasicScenario-server-672930101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-672930101',id=30,image_ref='e02d2ab7-d36b-42ce-8a09-589fe97d2745',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyN7ZXz/DhnftGXoG1DqPcVc2gONInGkCMU1F9WltEW9B7MyWX6QLuMCCaRSexfOtRkN3kvfw4EU0QaJ4W82L+01s5mIUUjLtEeLBACLFDo9jDFd26Q2mqx8aDpkmAeHQ==',key_name='tempest-TestMinimumBasicScenario-1723696496',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae2e95243bc4e19b093629197fbb173',ramdisk_id='',reservation_id='r-nhxs7xka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e02d2ab7-d36b-42ce-8a09-589fe97d2745',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-929002235',owner_user_name='tempest-TestMinimumBasicScenario-929002235-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:24:41Z,user_data=None,user_id='9e1f366e5f9d43b9bbd8be316ddaa3a9',uuid=49467859-954f-498d-b520-587c7f38effc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converting VIF {"id": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "address": "fa:16:3e:20:60:67", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcff28e3-32", "ovs_interfaceid": "bcff28e3-32d8-4f26-b087-4b1082f06cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:60:67,bridge_name='br-int',has_traffic_filtering=True,id=bcff28e3-32d8-4f26-b087-4b1082f06cfb,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcff28e3-32') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG os_vif [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:60:67,bridge_name='br-int',has_traffic_filtering=True,id=bcff28e3-32d8-4f26-b087-4b1082f06cfb,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcff28e3-32') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcff28e3-32, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:23 user nova-compute[72019]: INFO os_vif [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:60:67,bridge_name='br-int',has_traffic_filtering=True,id=bcff28e3-32d8-4f26-b087-4b1082f06cfb,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcff28e3-32')
Apr 14 13:27:23 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Deleting instance files /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc_del
Apr 14 13:27:23 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Deletion of /opt/stack/data/nova/instances/49467859-954f-498d-b520-587c7f38effc_del complete
Apr 14 13:27:23 user nova-compute[72019]: INFO nova.compute.manager [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 13:27:23 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 49467859-954f-498d-b520-587c7f38effc] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:27:23 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 49467859-954f-498d-b520-587c7f38effc] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:27:24 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 49467859-954f-498d-b520-587c7f38effc] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:27:24 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 49467859-954f-498d-b520-587c7f38effc] Took 0.52 seconds to deallocate network for instance.
Apr 14 13:27:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-31c791ea-93dd-40bd-951a-c257500ca10b req-35dd4fe3-2dda-4767-a7d6-b0a20da98e9e service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-vif-deleted-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:27:24 user nova-compute[72019]: INFO nova.compute.manager [req-31c791ea-93dd-40bd-951a-c257500ca10b req-35dd4fe3-2dda-4767-a7d6-b0a20da98e9e service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Neutron deleted interface bcff28e3-32d8-4f26-b087-4b1082f06cfb; detaching it from the instance and deleting it from the info cache
Apr 14 13:27:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-31c791ea-93dd-40bd-951a-c257500ca10b req-35dd4fe3-2dda-4767-a7d6-b0a20da98e9e service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:27:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-31c791ea-93dd-40bd-951a-c257500ca10b req-35dd4fe3-2dda-4767-a7d6-b0a20da98e9e service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Detach interface failed, port_id=bcff28e3-32d8-4f26-b087-4b1082f06cfb, reason: Instance 49467859-954f-498d-b520-587c7f38effc could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:27:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:24 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:27:24 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:27:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:24 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Deleted allocations for instance 49467859-954f-498d-b520-587c7f38effc
Apr 14 13:27:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "49467859-954f-498d-b520-587c7f38effc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.038s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-915363bd-c0f6-4f58-a765-674a640ed697 req-46da1199-2f2f-46f9-b231-b4ff92d17ec7 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:27:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-915363bd-c0f6-4f58-a765-674a640ed697 req-46da1199-2f2f-46f9-b231-b4ff92d17ec7 service nova] Acquiring lock "49467859-954f-498d-b520-587c7f38effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-915363bd-c0f6-4f58-a765-674a640ed697 req-46da1199-2f2f-46f9-b231-b4ff92d17ec7 service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-915363bd-c0f6-4f58-a765-674a640ed697 req-46da1199-2f2f-46f9-b231-b4ff92d17ec7 service nova] Lock "49467859-954f-498d-b520-587c7f38effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-915363bd-c0f6-4f58-a765-674a640ed697 req-46da1199-2f2f-46f9-b231-b4ff92d17ec7 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] No waiting events found dispatching network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:27:25 user nova-compute[72019]: WARNING nova.compute.manager [req-915363bd-c0f6-4f58-a765-674a640ed697 req-46da1199-2f2f-46f9-b231-b4ff92d17ec7 service nova] [instance: 49467859-954f-498d-b520-587c7f38effc] Received unexpected event network-vif-plugged-bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance with vm_state deleted and task_state None.
Apr 14 13:27:26 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:27:26 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:27:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:27 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:27:28 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:27:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:29 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:27:29 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:27:29 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Rebuilding the list of instances to heal {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 13:27:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:27:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:27:29 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:27:29 user nova-compute[72019]: DEBUG nova.objects.instance [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lazy-loading 'info_cache' on Instance uuid 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:27:30 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Updating instance_info_cache with network_info: [{"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:27:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-29dc5faa-e15a-425c-80f8-ddb4f34f43d4" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:27:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:27:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:27:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:27:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:27:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:27:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:34 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:27:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:27:34 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:35 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:27:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:35 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:36 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:27:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:27:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:27:38 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:27:38 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7672MB free_disk=26.023448944091797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Applying migration context for instance 6e646c88-579e-4ea1-b987-da1c7194a064 as it has an incoming, in-progress migration 5169f869-26b1-4d9b-b726-ebf138fd4b74. Migration status is finished {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 13:27:38 user nova-compute[72019]: INFO nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating resource usage from migration 5169f869-26b1-4d9b-b726-ebf138fd4b74
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 775293fc-1773-407d-bf49-fccfe849f440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Migration 5169f869-26b1-4d9b-b726-ebf138fd4b74 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478843.7976756, 49467859-954f-498d-b520-587c7f38effc => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:27:38 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 49467859-954f-498d-b520-587c7f38effc] VM Stopped (Lifecycle Event)
Apr 14 13:27:38 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b6e7e7d8-a872-4302-a305-1fedc81055a4 None None] [instance: 49467859-954f-498d-b520-587c7f38effc] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:27:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "775293fc-1773-407d-bf49-fccfe849f440" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:39 user nova-compute[72019]: INFO nova.compute.manager [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Terminating instance
Apr 14 13:27:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:27:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG nova.compute.manager [req-93aca140-bb60-4027-828d-e070402aa387 req-0e1a3244-2c7c-4d90-b4e9-cab79663899a service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-vif-unplugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-93aca140-bb60-4027-828d-e070402aa387 req-0e1a3244-2c7c-4d90-b4e9-cab79663899a service nova] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-93aca140-bb60-4027-828d-e070402aa387 req-0e1a3244-2c7c-4d90-b4e9-cab79663899a service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-93aca140-bb60-4027-828d-e070402aa387 req-0e1a3244-2c7c-4d90-b4e9-cab79663899a service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG nova.compute.manager [req-93aca140-bb60-4027-828d-e070402aa387 req-0e1a3244-2c7c-4d90-b4e9-cab79663899a service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] No waiting events found dispatching network-vif-unplugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG nova.compute.manager [req-93aca140-bb60-4027-828d-e070402aa387 req-0e1a3244-2c7c-4d90-b4e9-cab79663899a service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-vif-unplugged-aef4cd67-4e33-4456-b7d9-195955db1cdc for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:40 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Instance destroyed successfully.
Apr 14 13:27:40 user nova-compute[72019]: DEBUG nova.objects.instance [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'resources' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1752142358',display_name='tempest-ServerRescueNegativeTestJSON-server-1752142358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1752142358',id=28,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8A7EAZq7tmqrVNMLohBE3mL47WklU/y0g3C4awZJlk7zTwzptrakKyJKVosEv0afOebqhON5GWZWdR8IogeuUlgLuKQn8gHHZsiUBVmRBYXQ+jLuDfBW7YAbRSIevoPw==',key_name='tempest-keypair-1544885661',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:23:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7c8c8f620334166a141ea65525ba2a0',ramdisk_id='',reservation_id='r-w6mtz06d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1698214771',owner_user_name='tempest-ServerRescueNegativeTestJSON-1698214771-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3948b7c643374bcdbeb34f0f2f790c3c',uuid=775293fc-1773-407d-bf49-fccfe849f440,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converting VIF {"id": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "address": "fa:16:3e:44:e7:34", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef4cd67-4e", "ovs_interfaceid": "aef4cd67-4e33-4456-b7d9-195955db1cdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:e7:34,bridge_name='br-int',has_traffic_filtering=True,id=aef4cd67-4e33-4456-b7d9-195955db1cdc,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef4cd67-4e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG os_vif [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:e7:34,bridge_name='br-int',has_traffic_filtering=True,id=aef4cd67-4e33-4456-b7d9-195955db1cdc,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef4cd67-4e') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaef4cd67-4e, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:27:40 user nova-compute[72019]: INFO os_vif [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:e7:34,bridge_name='br-int',has_traffic_filtering=True,id=aef4cd67-4e33-4456-b7d9-195955db1cdc,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef4cd67-4e')
Apr 14 13:27:40 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Deleting instance files /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440_del
Apr 14 13:27:40 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Deletion of /opt/stack/data/nova/instances/775293fc-1773-407d-bf49-fccfe849f440_del complete
Apr 14 13:27:40 user nova-compute[72019]: INFO nova.compute.manager [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 13:27:40 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:27:40 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 775293fc-1773-407d-bf49-fccfe849f440] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:27:41 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:27:41 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Took 0.91 seconds to deallocate network for instance.
Apr 14 13:27:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:41 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:27:42 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:27:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:42 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Deleted allocations for instance 775293fc-1773-407d-bf49-fccfe849f440
Apr 14 13:27:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "775293fc-1773-407d-bf49-fccfe849f440" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.327s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:42 user nova-compute[72019]: DEBUG nova.compute.manager [req-3849451a-abe0-4746-9d01-be994a73c822 req-87ea9c49-0920-4f0f-954c-644913abaecb service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:27:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3849451a-abe0-4746-9d01-be994a73c822 req-87ea9c49-0920-4f0f-954c-644913abaecb service nova] Acquiring lock "775293fc-1773-407d-bf49-fccfe849f440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3849451a-abe0-4746-9d01-be994a73c822 req-87ea9c49-0920-4f0f-954c-644913abaecb service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3849451a-abe0-4746-9d01-be994a73c822 req-87ea9c49-0920-4f0f-954c-644913abaecb service nova] Lock "775293fc-1773-407d-bf49-fccfe849f440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:42 user nova-compute[72019]: DEBUG nova.compute.manager [req-3849451a-abe0-4746-9d01-be994a73c822 req-87ea9c49-0920-4f0f-954c-644913abaecb service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] No waiting events found dispatching network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:27:42 user nova-compute[72019]: WARNING nova.compute.manager [req-3849451a-abe0-4746-9d01-be994a73c822 req-87ea9c49-0920-4f0f-954c-644913abaecb service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received unexpected event network-vif-plugged-aef4cd67-4e33-4456-b7d9-195955db1cdc for instance with vm_state deleted and task_state None.
Apr 14 13:27:42 user nova-compute[72019]: DEBUG nova.compute.manager [req-3849451a-abe0-4746-9d01-be994a73c822 req-87ea9c49-0920-4f0f-954c-644913abaecb service nova] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Received event network-vif-deleted-aef4cd67-4e33-4456-b7d9-195955db1cdc {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:27:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:54 user nova-compute[72019]: INFO nova.compute.manager [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Terminating instance
Apr 14 13:27:54 user nova-compute[72019]: DEBUG nova.compute.manager [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-9c9518f3-931a-40dd-b2d5-1a1ebb6fd4ce req-957308dc-9bbe-4912-a467-8f0d102bd397 service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Received event network-vif-unplugged-643e5d33-1456-403f-ba06-e25ec6713e7d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9c9518f3-931a-40dd-b2d5-1a1ebb6fd4ce req-957308dc-9bbe-4912-a467-8f0d102bd397 service nova] Acquiring lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9c9518f3-931a-40dd-b2d5-1a1ebb6fd4ce req-957308dc-9bbe-4912-a467-8f0d102bd397 service nova] Lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9c9518f3-931a-40dd-b2d5-1a1ebb6fd4ce req-957308dc-9bbe-4912-a467-8f0d102bd397 service nova] Lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-9c9518f3-931a-40dd-b2d5-1a1ebb6fd4ce req-957308dc-9bbe-4912-a467-8f0d102bd397 service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] No waiting events found dispatching network-vif-unplugged-643e5d33-1456-403f-ba06-e25ec6713e7d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-9c9518f3-931a-40dd-b2d5-1a1ebb6fd4ce req-957308dc-9bbe-4912-a467-8f0d102bd397 service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Received event network-vif-unplugged-643e5d33-1456-403f-ba06-e25ec6713e7d for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:27:54 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Instance destroyed successfully.
Apr 14 13:27:54 user nova-compute[72019]: DEBUG nova.objects.instance [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lazy-loading 'resources' on Instance uuid b8fbde75-cf77-4069-91ac-9d9c92c65c24 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-825541492',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-825541492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-825541492',id=36,image_ref='b79415a7-1028-47c9-b6c3-8a8a7bfce629',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:26:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-w1ek030t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1645546988',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:26:21Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=b8fbde75-cf77-4069-91ac-9d9c92c65c24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "643e5d33-1456-403f-ba06-e25ec6713e7d", "address": "fa:16:3e:d7:f1:2b", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643e5d33-14", "ovs_interfaceid": "643e5d33-1456-403f-ba06-e25ec6713e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "643e5d33-1456-403f-ba06-e25ec6713e7d", "address": "fa:16:3e:d7:f1:2b", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643e5d33-14", "ovs_interfaceid": "643e5d33-1456-403f-ba06-e25ec6713e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f1:2b,bridge_name='br-int',has_traffic_filtering=True,id=643e5d33-1456-403f-ba06-e25ec6713e7d,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643e5d33-14') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG os_vif [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f1:2b,bridge_name='br-int',has_traffic_filtering=True,id=643e5d33-1456-403f-ba06-e25ec6713e7d,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643e5d33-14') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap643e5d33-14, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:27:54 user nova-compute[72019]: INFO os_vif [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f1:2b,bridge_name='br-int',has_traffic_filtering=True,id=643e5d33-1456-403f-ba06-e25ec6713e7d,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643e5d33-14')
Apr 14 13:27:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXWUsGgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:27:54 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:27:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:27:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d060c8b-a047-4083-bd49-d820e8aecd8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:27:55 user nova-compute[72019]: No targets found.
Apr 14 13:27:55 user nova-compute[72019]: iSNS:
Apr 14 13:27:55 user nova-compute[72019]: No targets found.
Apr 14 13:27:55 user nova-compute[72019]: STATIC:
Apr 14 13:27:55 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:27:55 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:27:55 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:27:55 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b
Apr 14 13:27:55 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:27:55 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:27:55 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29
Apr 14 13:27:55 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:27:55 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:27:55 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460
Apr 14 13:27:55 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:27:55 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:27:55 user nova-compute[72019]: FIRMWARE:
Apr 14 13:27:55 user nova-compute[72019]: No targets found.
Apr 14 13:27:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:27:55 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:27:55 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8adf04-c954-4afb-be39-eb8a9804c548]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da1c2fd-7ecc-4e88-91b9-3676d6ba6494]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:27:55 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:27:55 user nova-compute[72019]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)
Apr 14 13:27:55 user nova-compute[72019]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:27:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:27:55 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:27:55 user nova-compute[72019]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 (non-flash)
Apr 14 13:27:55 user nova-compute[72019]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:27:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7490778280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460'): ({'sdf'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Removing single pathed devices sdf {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e46d971-7003-485d-b1e4-3c365f0d1694]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0274adf8-2aaf-47ed-84e9-14c2cb7de9e4]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flushing IO for device /dev/sdf {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a077122-57af-40fd-a172-5704000c8167]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba14a2a-8907-432d-a6b6-9cb80e26a1cd]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] SCSI volumes sdf have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bdf4b3-6da3-4bef-a91c-4a5a2d147961]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdab8b45-ee92-4f1b-bad5-18a1441d66dc]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460, portal: 172.16.0.220,3260]
Apr 14 13:27:55 user nova-compute[72019]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460, portal: 172.16.0.220,3260] successful.
Apr 14 13:27:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7fde9f6-6813-4930-8d73-aa1fef697460 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aa819e-7ca8-4b1a-8720-773d07ac986e]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== disconnect_volume: return (326ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:27:55 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Deleting instance files /opt/stack/data/nova/instances/b8fbde75-cf77-4069-91ac-9d9c92c65c24_del
Apr 14 13:27:55 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Deletion of /opt/stack/data/nova/instances/b8fbde75-cf77-4069-91ac-9d9c92c65c24_del complete
Apr 14 13:27:55 user nova-compute[72019]: INFO nova.compute.manager [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 14 13:27:55 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478860.6181028, 775293fc-1773-407d-bf49-fccfe849f440 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:27:55 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 775293fc-1773-407d-bf49-fccfe849f440] VM Stopped (Lifecycle Event)
Apr 14 13:27:55 user nova-compute[72019]: DEBUG nova.compute.manager [None req-69885a28-7a1e-4c53-9c24-8529b83821cc None None] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:27:55 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:27:55 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Took 0.57 seconds to deallocate network for instance.
Apr 14 13:27:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-d49a7cdf-249c-4357-a8ea-9ea0198263a9 req-4d25cf21-2fea-4f8c-a0cd-165a4f39f12f service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Received event network-vif-deleted-643e5d33-1456-403f-ba06-e25ec6713e7d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:27:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-5a257b58-2cd3-4056-9695-d250ffc11218 req-30d256e9-8193-4592-ab33-544bb98c9ea6 service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Received event network-vif-plugged-643e5d33-1456-403f-ba06-e25ec6713e7d {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:27:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5a257b58-2cd3-4056-9695-d250ffc11218 req-30d256e9-8193-4592-ab33-544bb98c9ea6 service nova] Acquiring lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5a257b58-2cd3-4056-9695-d250ffc11218 req-30d256e9-8193-4592-ab33-544bb98c9ea6 service nova] Lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5a257b58-2cd3-4056-9695-d250ffc11218 req-30d256e9-8193-4592-ab33-544bb98c9ea6 service nova] Lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-5a257b58-2cd3-4056-9695-d250ffc11218 req-30d256e9-8193-4592-ab33-544bb98c9ea6 service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] No waiting events found dispatching network-vif-plugged-643e5d33-1456-403f-ba06-e25ec6713e7d {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:27:56 user nova-compute[72019]: WARNING nova.compute.manager [req-5a257b58-2cd3-4056-9695-d250ffc11218 req-30d256e9-8193-4592-ab33-544bb98c9ea6 service nova] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Received unexpected event network-vif-plugged-643e5d33-1456-403f-ba06-e25ec6713e7d for instance with vm_state active and task_state deleting.
Apr 14 13:27:57 user nova-compute[72019]: INFO nova.compute.manager [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Took 1.05 seconds to detach 1 volumes for instance.
Apr 14 13:27:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Deleting volume: d7fde9f6-6813-4930-8d73-aa1fef697460 {{(pid=72019) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 13:27:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:27:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:27:57 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:27:57 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:27:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:57 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Deleted allocations for instance b8fbde75-cf77-4069-91ac-9d9c92c65c24
Apr 14 13:27:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "b8fbde75-cf77-4069-91ac-9d9c92c65c24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.610s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:27:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:02 user nova-compute[72019]: DEBUG nova.network.neutron [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Port 25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 binding to destination host user is already ACTIVE {{(pid=72019) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 13:28:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:28:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquired lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:28:02 user nova-compute[72019]: DEBUG nova.network.neutron [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:28:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:02 user nova-compute[72019]: DEBUG nova.network.neutron [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating instance_info_cache with network_info: [{"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:28:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Releasing lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:28:02 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Creating tmpfile /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/tmpm06j7ima to verify with other compute node that the instance is on the same shared storage. {{(pid=72019) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 14 13:28:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG nova.compute.manager [req-6237fba6-c16d-4cab-8705-2b5b20c6da42 req-bb75b37c-6ac4-46d6-b003-557cab32b671 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6237fba6-c16d-4cab-8705-2b5b20c6da42 req-bb75b37c-6ac4-46d6-b003-557cab32b671 service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6237fba6-c16d-4cab-8705-2b5b20c6da42 req-bb75b37c-6ac4-46d6-b003-557cab32b671 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6237fba6-c16d-4cab-8705-2b5b20c6da42 req-bb75b37c-6ac4-46d6-b003-557cab32b671 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG nova.compute.manager [req-6237fba6-c16d-4cab-8705-2b5b20c6da42 req-bb75b37c-6ac4-46d6-b003-557cab32b671 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:03 user nova-compute[72019]: WARNING nova.compute.manager [req-6237fba6-c16d-4cab-8705-2b5b20c6da42 req-bb75b37c-6ac4-46d6-b003-557cab32b671 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state resized and task_state resize_reverting.
Apr 14 13:28:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:03 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance destroyed successfully.
Apr 14 13:28:03 user nova-compute[72019]: DEBUG nova.objects.instance [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'resources' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1306609806',display_name='tempest-ServerActionsTestJSON-server-1057847197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1306609806',id=21,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:26:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-n0fqg6y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=6e646c88-579e-4ea1-b987-da1c7194a064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_vif [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25b21f1a-fb, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:28:03 user nova-compute[72019]: INFO os_vif [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb')
Apr 14 13:28:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlHAIzEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:28:03 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4813b9be-1710-4fc3-8470-faca9d07ebda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:28:03 user nova-compute[72019]: No targets found.
Apr 14 13:28:03 user nova-compute[72019]: iSNS:
Apr 14 13:28:03 user nova-compute[72019]: No targets found.
Apr 14 13:28:03 user nova-compute[72019]: STATIC:
Apr 14 13:28:03 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:28:03 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:28:03 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:28:03 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b
Apr 14 13:28:03 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:28:03 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:28:03 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29
Apr 14 13:28:03 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:28:03 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:28:03 user nova-compute[72019]: FIRMWARE:
Apr 14 13:28:03 user nova-compute[72019]: No targets found.
Apr 14 13:28:03 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:28:03 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:28:03 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e192aa07-2a3f-47b5-83bc-01bb7ff94c32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2851b0-2776-4cf8-9a7f-2371236582fb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:03 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:03 user nova-compute[72019]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:03 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:03 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:03 user nova-compute[72019]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:03 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74900f3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b'): ({'sdg'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Removing single pathed devices sdg {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c2f7f0-1c9a-409a-8a01-f5e053f9d2ec]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa640cc-6d4f-4263-93d0-79f60679f6c9]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flushing IO for device /dev/sdg {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[311e8f2a-bffe-4ce0-9b66-65fc0f9e9ad3]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[48001e7c-2c76-40e3-9662-8a0f2082a3cc]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] SCSI volumes sdg have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3d706e-4e4c-46e8-80e8-7f3046c3d1e6]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86da689-4801-4048-b460-5ac16a187e2e]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260]
Apr 14 13:28:03 user nova-compute[72019]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260] successful.
Apr 14 13:28:03 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8c3af8-f5e4-4787-a478-ac2258f2efd5]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== disconnect_volume: return (366ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:28:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:28:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG nova.objects.instance [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'migration_context' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:05 user nova-compute[72019]: WARNING nova.compute.manager [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state resized and task_state resize_reverting.
Apr 14 13:28:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:05 user nova-compute[72019]: WARNING nova.compute.manager [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state resized and task_state resize_reverting.
Apr 14 13:28:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:05 user nova-compute[72019]: WARNING nova.compute.manager [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state resized and task_state resize_reverting.
Apr 14 13:28:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:05 user nova-compute[72019]: WARNING nova.compute.manager [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state resized and task_state resize_reverting.
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.427s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:05 user nova-compute[72019]: INFO nova.compute.manager [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Swapping old allocation on dict_keys(['9b2bb118-b0e4-40f8-89f7-8051d0c64569']) held by migration 5169f869-26b1-4d9b-b726-ebf138fd4b74 for instance
Apr 14 13:28:05 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Overwriting current allocation {'allocations': {'9b2bb118-b0e4-40f8-89f7-8051d0c64569': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 42}}, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'consumer_generation': 1} on consumer 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquired lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:28:05 user nova-compute[72019]: DEBUG nova.network.neutron [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG nova.network.neutron [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating instance_info_cache with network_info: [{"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Releasing lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG os_brick.utils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeafe467-e5a9-4da0-a88e-a0f9e59e1343]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cf224b-11aa-4b95-9e0c-f7a43de218fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[207d0898-4b3d-449f-bf3b-e7146df9dd3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[580c5428-8854-423c-8099-c0ae267c7840]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:28:06 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:28:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e825c84b-9b64-4b6e-9bdb-ec5d917eabc1]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:28:06 user nova-compute[72019]: DEBUG os_brick.utils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:28:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-1860c068-e8f1-4215-a471-5fe8a6c815b2 req-ce19431e-5f91-43cf-b63d-bb4807df424f service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1860c068-e8f1-4215-a471-5fe8a6c815b2 req-ce19431e-5f91-43cf-b63d-bb4807df424f service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1860c068-e8f1-4215-a471-5fe8a6c815b2 req-ce19431e-5f91-43cf-b63d-bb4807df424f service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1860c068-e8f1-4215-a471-5fe8a6c815b2 req-ce19431e-5f91-43cf-b63d-bb4807df424f service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-1860c068-e8f1-4215-a471-5fe8a6c815b2 req-ce19431e-5f91-43cf-b63d-bb4807df424f service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:07 user nova-compute[72019]: WARNING nova.compute.manager [req-1860c068-e8f1-4215-a471-5fe8a6c815b2 req-ce19431e-5f91-43cf-b63d-bb4807df424f service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state resized and task_state resize_reverting.
Apr 14 13:28:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:09 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478874.9422095, b8fbde75-cf77-4069-91ac-9d9c92c65c24 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:28:09 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] VM Stopped (Lifecycle Event)
Apr 14 13:28:09 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b9ad78f8-e2cb-4956-8faf-9eb138856558 None None] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:28:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Starting finish_revert_migration {{(pid=72019) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Start _get_guest_xml network_info=[{"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '05afc59a-cbe2-441a-a18a-6d9c68a94eda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlHAIzEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6e646c88-579e-4ea1-b987-da1c7194a064', 'attached_at': '2023-04-14T13:28:12.000000', 'detached_at': '', 'volume_id': '3452b973-eab5-49dc-b950-2f515a6c4f1b', 'serial': '3452b973-eab5-49dc-b950-2f515a6c4f1b'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:28:11 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:28:11 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.objects.instance [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlHAIzEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:28:11 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:28:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:28:11 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:28:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:28:11 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b32a08-7761-45d7-9779-44621e37d9b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:28:11 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf3c38a-31da-4785-bbf3-962c70f62d6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b] added
Apr 14 13:28:11 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a9534b-217c-4a0e-857d-c6bc78839fb9]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f52fe6-eddb-4681-805a-445884e3733e]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlHAIzEb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlHAIzEb" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1eb5d1-54d9-482b-9f66-2468c87f67ac]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BlHAIzEb'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72e2e5f-e26f-467e-8e4a-e1ce76bf0345]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:11 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c897cb7f-b82c-4f38-ace6-2626acbfc765]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:12 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:12 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:12 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:12 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c85e4db-bc77-495d-b723-e0d914c85557]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260]
Apr 14 13:28:12 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260] successful.
Apr 14 13:28:12 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bad22e1-557c-4c78-b174-777d3c2433b7]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4246ed61-26c3-45ad-9dd8-bebd866c9f04]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:12 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:12 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:12 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:12 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:12 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:12 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd89abf7-0ae5-4175-9bc3-08a68b5dbbb7]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlHAIzEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:28:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23561646662643261', 'path': '/dev/sdb'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561646662643261', 'path': '/dev/sdb'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1306609806',display_name='tempest-ServerActionsTestJSON-server-1057847197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1306609806',id=21,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:26:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-n0fqg6y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=6e646c88-579e-4ea1-b987-da1c7194a064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:28:13 user nova-compute[72019]:   <uuid>6e646c88-579e-4ea1-b987-da1c7194a064</uuid>
Apr 14 13:28:13 user nova-compute[72019]:   <name>instance-00000015</name>
Apr 14 13:28:13 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:28:13 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:28:13 user nova-compute[72019]:   <metadata>
Apr 14 13:28:13 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:28:13 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:28:13 user nova-compute[72019]:       <nova:name>tempest-ServerActionsTestJSON-server-1057847197</nova:name>
Apr 14 13:28:13 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:28:11</nova:creationTime>
Apr 14 13:28:13 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:28:13 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:28:13 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:28:13 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:28:13 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:28:13 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:28:13 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:28:13 user nova-compute[72019]:       <nova:owner>
Apr 14 13:28:13 user nova-compute[72019]:         <nova:user uuid="9169729edbd04fd5a74d2cffd0aa437f">tempest-ServerActionsTestJSON-1929049437-project-member</nova:user>
Apr 14 13:28:13 user nova-compute[72019]:         <nova:project uuid="4b197f1df57f4dee9757639cf861eb97">tempest-ServerActionsTestJSON-1929049437</nova:project>
Apr 14 13:28:13 user nova-compute[72019]:       </nova:owner>
Apr 14 13:28:13 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:28:13 user nova-compute[72019]:       <nova:ports>
Apr 14 13:28:13 user nova-compute[72019]:         <nova:port uuid="25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7">
Apr 14 13:28:13 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 13:28:13 user nova-compute[72019]:         </nova:port>
Apr 14 13:28:13 user nova-compute[72019]:       </nova:ports>
Apr 14 13:28:13 user nova-compute[72019]:     </nova:instance>
Apr 14 13:28:13 user nova-compute[72019]:   </metadata>
Apr 14 13:28:13 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:28:13 user nova-compute[72019]:     <system>
Apr 14 13:28:13 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:28:13 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:28:13 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:28:13 user nova-compute[72019]:       <entry name="serial">6e646c88-579e-4ea1-b987-da1c7194a064</entry>
Apr 14 13:28:13 user nova-compute[72019]:       <entry name="uuid">6e646c88-579e-4ea1-b987-da1c7194a064</entry>
Apr 14 13:28:13 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:28:13 user nova-compute[72019]:     </system>
Apr 14 13:28:13 user nova-compute[72019]:   </sysinfo>
Apr 14 13:28:13 user nova-compute[72019]:   <os>
Apr 14 13:28:13 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:28:13 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:28:13 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:28:13 user nova-compute[72019]:   </os>
Apr 14 13:28:13 user nova-compute[72019]:   <features>
Apr 14 13:28:13 user nova-compute[72019]:     <acpi/>
Apr 14 13:28:13 user nova-compute[72019]:     <apic/>
Apr 14 13:28:13 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:28:13 user nova-compute[72019]:   </features>
Apr 14 13:28:13 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:28:13 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:28:13 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:28:13 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:28:13 user nova-compute[72019]:   </clock>
Apr 14 13:28:13 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:28:13 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:28:13 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:28:13 user nova-compute[72019]:   </cpu>
Apr 14 13:28:13 user nova-compute[72019]:   <devices>
Apr 14 13:28:13 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:28:13 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:28:13 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk"/>
Apr 14 13:28:13 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:28:13 user nova-compute[72019]:     </disk>
Apr 14 13:28:13 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:28:13 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:28:13 user nova-compute[72019]:       <source dev="/dev/sdb"/>
Apr 14 13:28:13 user nova-compute[72019]:       <target dev="vdb" bus="virtio"/>
Apr 14 13:28:13 user nova-compute[72019]:       <serial>3452b973-eab5-49dc-b950-2f515a6c4f1b</serial>
Apr 14 13:28:13 user nova-compute[72019]:     </disk>
Apr 14 13:28:13 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:28:13 user nova-compute[72019]:       <mac address="fa:16:3e:28:28:75"/>
Apr 14 13:28:13 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:28:13 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:28:13 user nova-compute[72019]:       <target dev="tap25b21f1a-fb"/>
Apr 14 13:28:13 user nova-compute[72019]:     </interface>
Apr 14 13:28:13 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:28:13 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/console.log" append="off"/>
Apr 14 13:28:13 user nova-compute[72019]:     </serial>
Apr 14 13:28:13 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:28:13 user nova-compute[72019]:     <video>
Apr 14 13:28:13 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:28:13 user nova-compute[72019]:     </video>
Apr 14 13:28:13 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:28:13 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:28:13 user nova-compute[72019]:     </rng>
Apr 14 13:28:13 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:28:13 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:28:13 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:28:13 user nova-compute[72019]:     </memballoon>
Apr 14 13:28:13 user nova-compute[72019]:   </devices>
Apr 14 13:28:13 user nova-compute[72019]: </domain>
Apr 14 13:28:13 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1306609806',display_name='tempest-ServerActionsTestJSON-server-1057847197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1306609806',id=21,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:26:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-n0fqg6y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=6e646c88-579e-4ea1-b987-da1c7194a064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG os_vif [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25b21f1a-fb, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25b21f1a-fb, col_values=(('external_ids', {'iface-id': '25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:28:75', 'vm-uuid': '6e646c88-579e-4ea1-b987-da1c7194a064'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:28:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:13 user nova-compute[72019]: INFO os_vif [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb')
Apr 14 13:28:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-3dbc77f6-a13e-4d98-be62-b22ad2cfb973 req-ba28f3d1-4f5a-4814-a2bc-09cea6a8ea37 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3dbc77f6-a13e-4d98-be62-b22ad2cfb973 req-ba28f3d1-4f5a-4814-a2bc-09cea6a8ea37 service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3dbc77f6-a13e-4d98-be62-b22ad2cfb973 req-ba28f3d1-4f5a-4814-a2bc-09cea6a8ea37 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-3dbc77f6-a13e-4d98-be62-b22ad2cfb973 req-ba28f3d1-4f5a-4814-a2bc-09cea6a8ea37 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-3dbc77f6-a13e-4d98-be62-b22ad2cfb973 req-ba28f3d1-4f5a-4814-a2bc-09cea6a8ea37 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:14 user nova-compute[72019]: WARNING nova.compute.manager [req-3dbc77f6-a13e-4d98-be62-b22ad2cfb973 req-ba28f3d1-4f5a-4814-a2bc-09cea6a8ea37 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state resized and task_state resize_reverting.
Apr 14 13:28:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-407fb37c-2318-4f2f-bf1c-10b4f254642a req-00328ba2-d48b-488e-80d4-fcb0c10aee36 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-407fb37c-2318-4f2f-bf1c-10b4f254642a req-00328ba2-d48b-488e-80d4-fcb0c10aee36 service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-407fb37c-2318-4f2f-bf1c-10b4f254642a req-00328ba2-d48b-488e-80d4-fcb0c10aee36 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-407fb37c-2318-4f2f-bf1c-10b4f254642a req-00328ba2-d48b-488e-80d4-fcb0c10aee36 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-407fb37c-2318-4f2f-bf1c-10b4f254642a req-00328ba2-d48b-488e-80d4-fcb0c10aee36 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:17 user nova-compute[72019]: WARNING nova.compute.manager [req-407fb37c-2318-4f2f-bf1c-10b4f254642a req-00328ba2-d48b-488e-80d4-fcb0c10aee36 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state resized and task_state resize_reverting.
Apr 14 13:28:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for 6e646c88-579e-4ea1-b987-da1c7194a064 due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:28:17 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478897.1943805, 6e646c88-579e-4ea1-b987-da1c7194a064 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:28:17 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] VM Resumed (Lifecycle Event)
Apr 14 13:28:17 user nova-compute[72019]: DEBUG nova.compute.manager [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:28:17 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance running successfully.
Apr 14 13:28:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] finish_revert_migration finished successfully. {{(pid=72019) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 14 13:28:17 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:28:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:17 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:28:17 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 13:28:17 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478897.19588, 6e646c88-579e-4ea1-b987-da1c7194a064 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:28:17 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] VM Started (Lifecycle Event)
Apr 14 13:28:17 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:28:17 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:28:17 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 13:28:17 user nova-compute[72019]: INFO nova.compute.manager [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating instance to original state: 'active'
Apr 14 13:28:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:18 user nova-compute[72019]: DEBUG nova.compute.manager [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:28:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:18 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:28:18 user nova-compute[72019]: INFO nova.compute.claims [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Claim successful on node user
Apr 14 13:28:18 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:28:18 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:28:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:18 user nova-compute[72019]: DEBUG nova.compute.manager [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:28:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:28:19 user nova-compute[72019]: DEBUG nova.network.neutron [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:28:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:28:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:28:19 user nova-compute[72019]: DEBUG nova.policy [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:28:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:28:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:28:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Creating image(s)
Apr 14 13:28:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "/opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "/opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "/opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "a13b9e5749b4a13f01d13c74d65e463282d7611e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "a13b9e5749b4a13f01d13c74d65e463282d7611e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e.part --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e.part --force-share --output=json" returned: 0 in 0.199s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:19 user nova-compute[72019]: DEBUG nova.virt.images [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 8ce99b3b-1304-4e73-a97b-e88d2addf3cd was qcow2, converting to raw {{(pid=72019) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 13:28:19 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:28:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e.part /opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e.converted {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG nova.network.neutron [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Successfully created port: 40073711-7679-449b-8856-60989099101c {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e.part /opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e.converted" returned: 0 in 0.302s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e.converted --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e.converted --force-share --output=json" returned: 0 in 0.159s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "a13b9e5749b4a13f01d13c74d65e463282d7611e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.094s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e --force-share --output=json" returned: 0 in 0.169s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "a13b9e5749b4a13f01d13c74d65e463282d7611e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "a13b9e5749b4a13f01d13c74d65e463282d7611e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e --force-share --output=json" returned: 0 in 0.171s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e,backing_fmt=raw /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e,backing_fmt=raw /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk 1073741824" returned: 0 in 0.084s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "a13b9e5749b4a13f01d13c74d65e463282d7611e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:28:20 user nova-compute[72019]: INFO nova.compute.claims [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Claim successful on node user
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a13b9e5749b4a13f01d13c74d65e463282d7611e --force-share --output=json" returned: 0 in 0.154s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:28:20 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.network.neutron [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Successfully updated port: 40073711-7679-449b-8856-60989099101c {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquired lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.network.neutron [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.network.neutron [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-e7e192af-b4a7-4f85-88f0-315ce872aabf req-c4a67105-e7a2-4661-a22f-22c3eadfed20 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-changed-40073711-7679-449b-8856-60989099101c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-e7e192af-b4a7-4f85-88f0-315ce872aabf req-c4a67105-e7a2-4661-a22f-22c3eadfed20 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Refreshing instance network info cache due to event network-changed-40073711-7679-449b-8856-60989099101c. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e7e192af-b4a7-4f85-88f0-315ce872aabf req-c4a67105-e7a2-4661-a22f-22c3eadfed20 service nova] Acquiring lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Cannot resize image /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.objects.instance [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'migration_context' on Instance uuid 9970f98b-ade9-4d08-a88d-b11a222adcf9 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Ensure instance console log exists: /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.181s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:28:21 user nova-compute[72019]: INFO nova.compute.claims [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Claim successful on node user
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.network.neutron [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Updating instance_info_cache with network_info: [{"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Releasing lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Instance network_info: |[{"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e7e192af-b4a7-4f85-88f0-315ce872aabf req-c4a67105-e7a2-4661-a22f-22c3eadfed20 service nova] Acquired lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.network.neutron [req-e7e192af-b4a7-4f85-88f0-315ce872aabf req-c4a67105-e7a2-4661-a22f-22c3eadfed20 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Refreshing network info cache for port 40073711-7679-449b-8856-60989099101c {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Start _get_guest_xml network_info=[{"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:28:14Z,direct_url=<?>,disk_format='qcow2',id=8ce99b3b-1304-4e73-a97b-e88d2addf3cd,min_disk=0,min_ram=0,name='tempest-scenario-img--2144234402',owner='9ae2e95243bc4e19b093629197fbb173',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:28:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '8ce99b3b-1304-4e73-a97b-e88d2addf3cd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:28:21 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:28:21 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:28:21 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:28:14Z,direct_url=<?>,disk_format='qcow2',id=8ce99b3b-1304-4e73-a97b-e88d2addf3cd,min_disk=0,min_ram=0,name='tempest-scenario-img--2144234402',owner='9ae2e95243bc4e19b093629197fbb173',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:28:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1063896944',display_name='tempest-TestMinimumBasicScenario-server-1063896944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1063896944',id=38,image_ref='8ce99b3b-1304-4e73-a97b-e88d2addf3cd',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlGI9D4/7pv9vQ3CZXSBbrtbkDj0yyrDe0vnPovM9eQS+33AyfYa6U/m76AkDp7hpito5RK9q+cvN4dfCRtTK05lrs3oeIET8QKJZApVgXOoADHebmvp9epkF8YKFm31Q==',key_name='tempest-TestMinimumBasicScenario-1166797782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae2e95243bc4e19b093629197fbb173',ramdisk_id='',reservation_id='r-sm5kx50s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8ce99b3b-1304-4e73-a97b-e88d2addf3cd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-929002235',owner_user_name='tempest-TestMinimumBasicScenario-929002235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:28:19Z,user_data=None,user_id='9e1f366e5f9d43b9bbd8be316ddaa3a9',uuid=9970f98b-ade9-4d08-a88d-b11a222adcf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converting VIF {"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:31:bf,bridge_name='br-int',has_traffic_filtering=True,id=40073711-7679-449b-8856-60989099101c,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40073711-76') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.objects.instance [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'pci_devices' on Instance uuid 9970f98b-ade9-4d08-a88d-b11a222adcf9 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:28:21 user nova-compute[72019]:   <uuid>9970f98b-ade9-4d08-a88d-b11a222adcf9</uuid>
Apr 14 13:28:21 user nova-compute[72019]:   <name>instance-00000026</name>
Apr 14 13:28:21 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:28:21 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:28:21 user nova-compute[72019]:   <metadata>
Apr 14 13:28:21 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:28:21 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:28:21 user nova-compute[72019]:       <nova:name>tempest-TestMinimumBasicScenario-server-1063896944</nova:name>
Apr 14 13:28:21 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:28:21</nova:creationTime>
Apr 14 13:28:21 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:28:21 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:28:21 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:28:21 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:28:21 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:28:21 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:28:21 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:28:21 user nova-compute[72019]:       <nova:owner>
Apr 14 13:28:21 user nova-compute[72019]:         <nova:user uuid="9e1f366e5f9d43b9bbd8be316ddaa3a9">tempest-TestMinimumBasicScenario-929002235-project-member</nova:user>
Apr 14 13:28:21 user nova-compute[72019]:         <nova:project uuid="9ae2e95243bc4e19b093629197fbb173">tempest-TestMinimumBasicScenario-929002235</nova:project>
Apr 14 13:28:21 user nova-compute[72019]:       </nova:owner>
Apr 14 13:28:21 user nova-compute[72019]:       <nova:root type="image" uuid="8ce99b3b-1304-4e73-a97b-e88d2addf3cd"/>
Apr 14 13:28:21 user nova-compute[72019]:       <nova:ports>
Apr 14 13:28:21 user nova-compute[72019]:         <nova:port uuid="40073711-7679-449b-8856-60989099101c">
Apr 14 13:28:21 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 13:28:21 user nova-compute[72019]:         </nova:port>
Apr 14 13:28:21 user nova-compute[72019]:       </nova:ports>
Apr 14 13:28:21 user nova-compute[72019]:     </nova:instance>
Apr 14 13:28:21 user nova-compute[72019]:   </metadata>
Apr 14 13:28:21 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:28:21 user nova-compute[72019]:     <system>
Apr 14 13:28:21 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:28:21 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:28:21 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:28:21 user nova-compute[72019]:       <entry name="serial">9970f98b-ade9-4d08-a88d-b11a222adcf9</entry>
Apr 14 13:28:21 user nova-compute[72019]:       <entry name="uuid">9970f98b-ade9-4d08-a88d-b11a222adcf9</entry>
Apr 14 13:28:21 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:28:21 user nova-compute[72019]:     </system>
Apr 14 13:28:21 user nova-compute[72019]:   </sysinfo>
Apr 14 13:28:21 user nova-compute[72019]:   <os>
Apr 14 13:28:21 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:28:21 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:28:21 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:28:21 user nova-compute[72019]:   </os>
Apr 14 13:28:21 user nova-compute[72019]:   <features>
Apr 14 13:28:21 user nova-compute[72019]:     <acpi/>
Apr 14 13:28:21 user nova-compute[72019]:     <apic/>
Apr 14 13:28:21 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:28:21 user nova-compute[72019]:   </features>
Apr 14 13:28:21 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:28:21 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:28:21 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:28:21 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:28:21 user nova-compute[72019]:   </clock>
Apr 14 13:28:21 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:28:21 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:28:21 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:28:21 user nova-compute[72019]:   </cpu>
Apr 14 13:28:21 user nova-compute[72019]:   <devices>
Apr 14 13:28:21 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:28:21 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:28:21 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk"/>
Apr 14 13:28:21 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:28:21 user nova-compute[72019]:     </disk>
Apr 14 13:28:21 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:28:21 user nova-compute[72019]:       <mac address="fa:16:3e:79:31:bf"/>
Apr 14 13:28:21 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:28:21 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:28:21 user nova-compute[72019]:       <target dev="tap40073711-76"/>
Apr 14 13:28:21 user nova-compute[72019]:     </interface>
Apr 14 13:28:21 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:28:21 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/console.log" append="off"/>
Apr 14 13:28:21 user nova-compute[72019]:     </serial>
Apr 14 13:28:21 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:28:21 user nova-compute[72019]:     <video>
Apr 14 13:28:21 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:28:21 user nova-compute[72019]:     </video>
Apr 14 13:28:21 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:28:21 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:28:21 user nova-compute[72019]:     </rng>
Apr 14 13:28:21 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:28:21 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:28:21 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:28:21 user nova-compute[72019]:     </memballoon>
Apr 14 13:28:21 user nova-compute[72019]:   </devices>
Apr 14 13:28:21 user nova-compute[72019]: </domain>
Apr 14 13:28:21 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1063896944',display_name='tempest-TestMinimumBasicScenario-server-1063896944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1063896944',id=38,image_ref='8ce99b3b-1304-4e73-a97b-e88d2addf3cd',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlGI9D4/7pv9vQ3CZXSBbrtbkDj0yyrDe0vnPovM9eQS+33AyfYa6U/m76AkDp7hpito5RK9q+cvN4dfCRtTK05lrs3oeIET8QKJZApVgXOoADHebmvp9epkF8YKFm31Q==',key_name='tempest-TestMinimumBasicScenario-1166797782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae2e95243bc4e19b093629197fbb173',ramdisk_id='',reservation_id='r-sm5kx50s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8ce99b3b-1304-4e73-a97b-e88d2addf3cd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-929002235',owner_user_name='tempest-TestMinimumBasicScenario-929002235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:28:19Z,user_data=None,user_id='9e1f366e5f9d43b9bbd8be316ddaa3a9',uuid=9970f98b-ade9-4d08-a88d-b11a222adcf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converting VIF {"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:31:bf,bridge_name='br-int',has_traffic_filtering=True,id=40073711-7679-449b-8856-60989099101c,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40073711-76') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG os_vif [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:31:bf,bridge_name='br-int',has_traffic_filtering=True,id=40073711-7679-449b-8856-60989099101c,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40073711-76') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:28:21 user nova-compute[72019]: INFO nova.virt.block_device [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Booting with volume-backed-image 364f8f0e-9be3-4fd9-80d8-be290e16b4b1 at /dev/vda
Apr 14 13:28:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40073711-76, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40073711-76, col_values=(('external_ids', {'iface-id': '40073711-7679-449b-8856-60989099101c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:31:bf', 'vm-uuid': '9970f98b-ade9-4d08-a88d-b11a222adcf9'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:21 user nova-compute[72019]: INFO os_vif [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:31:bf,bridge_name='br-int',has_traffic_filtering=True,id=40073711-7679-449b-8856-60989099101c,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40073711-76')
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.policy [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:28:21 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] No VIF found with MAC fa:16:3e:79:31:bf, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:28:22 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:28:22 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:28:22 user nova-compute[72019]: INFO nova.virt.block_device [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Booting with volume 2724b817-0ad1-4678-9429-3f4e67a0f590 at /dev/vda
Apr 14 13:28:22 user nova-compute[72019]: DEBUG nova.policy [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01b25b886ade4e6ea689010d655d99a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9f3b2ecb541aba4516734fdebd316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG os_brick.utils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG nova.network.neutron [req-e7e192af-b4a7-4f85-88f0-315ce872aabf req-c4a67105-e7a2-4661-a22f-22c3eadfed20 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Updated VIF entry in instance network info cache for port 40073711-7679-449b-8856-60989099101c. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG nova.network.neutron [req-e7e192af-b4a7-4f85-88f0-315ce872aabf req-c4a67105-e7a2-4661-a22f-22c3eadfed20 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Updating instance_info_cache with network_info: [{"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e7e192af-b4a7-4f85-88f0-315ce872aabf req-c4a67105-e7a2-4661-a22f-22c3eadfed20 service nova] Releasing lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9938fc2-49e7-434d-9eb3-7ec1abe2e11e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36ac731-3ae6-47af-bbcd-b6c7ba405d21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d46b80-f133-45d6-881d-304a73a80a68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6226c464-23f5-4bfe-b897-07be715a9046]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:28:22 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:28:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5f8f2b-64b2-413d-ba47-75f63f35503e]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG os_brick.utils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updating existing volume attachment record: c57403a6-69e6-4892-86d6-1df031c7b736 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:28:22 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Successfully created port: 7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Successfully created port: 2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Successfully updated port: 7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-d61f8bd4-2b19-477e-bb13-4c0273321b33 req-72b51866-e497-454a-bd63-39e45d1d1e0a service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-vif-plugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d61f8bd4-2b19-477e-bb13-4c0273321b33 req-72b51866-e497-454a-bd63-39e45d1d1e0a service nova] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d61f8bd4-2b19-477e-bb13-4c0273321b33 req-72b51866-e497-454a-bd63-39e45d1d1e0a service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d61f8bd4-2b19-477e-bb13-4c0273321b33 req-72b51866-e497-454a-bd63-39e45d1d1e0a service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-d61f8bd4-2b19-477e-bb13-4c0273321b33 req-72b51866-e497-454a-bd63-39e45d1d1e0a service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] No waiting events found dispatching network-vif-plugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:23 user nova-compute[72019]: WARNING nova.compute.manager [req-d61f8bd4-2b19-477e-bb13-4c0273321b33 req-72b51866-e497-454a-bd63-39e45d1d1e0a service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received unexpected event network-vif-plugged-40073711-7679-449b-8856-60989099101c for instance with vm_state building and task_state spawning.
Apr 14 13:28:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "refresh_cache-626abaa0-3f53-42cc-978e-21f0a80232fa" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquired lock "refresh_cache-626abaa0-3f53-42cc-978e-21f0a80232fa" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-fa0de5bc-83fd-4dc6-8328-198b73ecb7f6 req-fa083149-6674-4df3-b9cd-cbf0c15ea041 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-changed-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-fa0de5bc-83fd-4dc6-8328-198b73ecb7f6 req-fa083149-6674-4df3-b9cd-cbf0c15ea041 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Refreshing instance network info cache due to event network-changed-7d5d9e2b-b502-494a-ac52-70930eda92ac. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fa0de5bc-83fd-4dc6-8328-198b73ecb7f6 req-fa083149-6674-4df3-b9cd-cbf0c15ea041 service nova] Acquiring lock "refresh_cache-626abaa0-3f53-42cc-978e-21f0a80232fa" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:28:23 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Updating instance_info_cache with network_info: [{"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Releasing lock "refresh_cache-626abaa0-3f53-42cc-978e-21f0a80232fa" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Instance network_info: |[{"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fa0de5bc-83fd-4dc6-8328-198b73ecb7f6 req-fa083149-6674-4df3-b9cd-cbf0c15ea041 service nova] Acquired lock "refresh_cache-626abaa0-3f53-42cc-978e-21f0a80232fa" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-fa0de5bc-83fd-4dc6-8328-198b73ecb7f6 req-fa083149-6674-4df3-b9cd-cbf0c15ea041 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Refreshing network info cache for port 7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Successfully updated port: 2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquired lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updating instance_info_cache with network_info: [{"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Releasing lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Instance network_info: |[{"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-fa0de5bc-83fd-4dc6-8328-198b73ecb7f6 req-fa083149-6674-4df3-b9cd-cbf0c15ea041 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Updated VIF entry in instance network info cache for port 7d5d9e2b-b502-494a-ac52-70930eda92ac. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-fa0de5bc-83fd-4dc6-8328-198b73ecb7f6 req-fa083149-6674-4df3-b9cd-cbf0c15ea041 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Updating instance_info_cache with network_info: [{"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:28:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fa0de5bc-83fd-4dc6-8328-198b73ecb7f6 req-fa083149-6674-4df3-b9cd-cbf0c15ea041 service nova] Releasing lock "refresh_cache-626abaa0-3f53-42cc-978e-21f0a80232fa" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478905.6114383, 9970f98b-ade9-4d08-a88d-b11a222adcf9 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:28:25 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] VM Resumed (Lifecycle Event)
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:28:25 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Instance spawned successfully.
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:25 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478905.6182568, 9970f98b-ade9-4d08-a88d-b11a222adcf9 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:28:25 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] VM Started (Lifecycle Event)
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:28:25 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:28:25 user nova-compute[72019]: INFO nova.compute.manager [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Took 6.46 seconds to spawn the instance on the hypervisor.
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:28:25 user nova-compute[72019]: INFO nova.compute.manager [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Took 7.51 seconds to build instance.
Apr 14 13:28:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.674s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-vif-plugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] No waiting events found dispatching network-vif-plugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:25 user nova-compute[72019]: WARNING nova.compute.manager [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received unexpected event network-vif-plugged-40073711-7679-449b-8856-60989099101c for instance with vm_state active and task_state None.
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-changed-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Refreshing instance network info cache due to event network-changed-2a3ecee8-e3fc-433e-81d5-f0c9decfd248. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] Acquiring lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] Acquired lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:28:25 user nova-compute[72019]: DEBUG nova.network.neutron [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Refreshing network info cache for port 2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:28:26 user nova-compute[72019]: DEBUG nova.network.neutron [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updated VIF entry in instance network info cache for port 2a3ecee8-e3fc-433e-81d5-f0c9decfd248. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:28:26 user nova-compute[72019]: DEBUG nova.network.neutron [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updating instance_info_cache with network_info: [{"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:28:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] Releasing lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:28:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.utils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4b5ab1-f074-47c1-b18b-16b8b8f78a53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba739e0-76d0-4243-92f9-6d5521647015]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[09473b63-248a-4b37-a0a2-486e36644042]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[856c196a-19a9-41ae-8b06-da6acf9a2671]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:28:27 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f7cf32-8a3f-457c-a85e-53ddc64a20d9]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.utils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Updating existing volume attachment record: 597f8f8d-f3ff-45ab-94b5-edc0311bd571 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:28:27 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Creating image(s)
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Ensure instance console log exists: /opt/stack/data/nova/instances/04cf64b3-e51b-418f-94f6-7597c4cd74bb/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Start _get_guest_xml network_info=[{"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c57403a6-69e6-4892-86d6-1df031c7b736', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAkcHOeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04cf64b3-e51b-418f-94f6-7597c4cd74bb', 'attached_at': '', 'detached_at': '', 'volume_id': '2724b817-0ad1-4678-9429-3f4e67a0f590', 'serial': '2724b817-0ad1-4678-9429-3f4e67a0f590'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:28:27 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:28:27 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAkcHOeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:28:27 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:28:27 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:28:27 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c90c9d-92b7-4e6f-ae10-2f08145839da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:28:27 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c408ddd0-6eb7-4f9d-b129-ef73b2016110]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590] added
Apr 14 13:28:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6684631-eba2-42c5-b07f-64a0dde5a7e0]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a717763c-40a4-4328-964e-8ca0ae9bc9c4]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fAkcHOeP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fAkcHOeP" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3a7b75-7a56-4df1-a90a-5bd84d5a6d3b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fAkcHOeP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d97d28e-0da0-4cd8-aaaf-bd9ed332bc18]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[722eee28-f835-44ea-b12f-fc125716fc0e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:27 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:27 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:27 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:27 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c3bc6e-a13b-43d2-8fbe-31c07e084770]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260]
Apr 14 13:28:27 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260] successful.
Apr 14 13:28:27 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:27 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6a43c4-4dbe-4ea3-9ce3-5906bc1b2198]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b19821-34b9-42b5-a386-f177cb4b452a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:28 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:28 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:28 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:28:28 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:28 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:28 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:28 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:28:28 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[85567403-f672-40fb-ab6e-e5a185b3954e]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:28:28 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAkcHOeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26363663430613230', 'path': '/dev/sde'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363663430613230', 'path': '/dev/sde'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-548766851',display_name='tempest-TestShelveInstance-server-548766851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-548766851',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIS8eIL/I3kxODqxFDmjVZgbwaBnYYyEpymoIT8frdOJIbK3dXh9J9GGKAL9gBIvS+6clwDRwZVCayK/ppHQaSnk+tDF7XA0oMOuQgWly6j9ws3NqPQ/uDU7zZbqKPJbIA==',key_name='tempest-TestShelveInstance-1155531040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ba9f3b2ecb541aba4516734fdebd316',ramdisk_id='',reservation_id='r-6bf35sr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-615050191',owner_user_name='tempest-TestShelveInstance-615050191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:28:22Z,user_data=None,user_id='01b25b886ade4e6ea689010d655d99a0',uuid=04cf64b3-e51b-418f-94f6-7597c4cd74bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Converting VIF {"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c4:3d,bridge_name='br-int',has_traffic_filtering=True,id=2a3ecee8-e3fc-433e-81d5-f0c9decfd248,network=Network(0a7d4ddd-e535-4d06-a605-a34d3ef8188c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3ecee8-e3') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG nova.objects.instance [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lazy-loading 'pci_devices' on Instance uuid 04cf64b3-e51b-418f-94f6-7597c4cd74bb {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:28:29 user nova-compute[72019]:   <uuid>04cf64b3-e51b-418f-94f6-7597c4cd74bb</uuid>
Apr 14 13:28:29 user nova-compute[72019]:   <name>instance-00000028</name>
Apr 14 13:28:29 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:28:29 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:28:29 user nova-compute[72019]:   <metadata>
Apr 14 13:28:29 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:28:29 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:28:29 user nova-compute[72019]:       <nova:name>tempest-TestShelveInstance-server-548766851</nova:name>
Apr 14 13:28:29 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:28:27</nova:creationTime>
Apr 14 13:28:29 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:28:29 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:28:29 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:28:29 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:28:29 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:28:29 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:28:29 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:28:29 user nova-compute[72019]:       <nova:owner>
Apr 14 13:28:29 user nova-compute[72019]:         <nova:user uuid="01b25b886ade4e6ea689010d655d99a0">tempest-TestShelveInstance-615050191-project-member</nova:user>
Apr 14 13:28:29 user nova-compute[72019]:         <nova:project uuid="6ba9f3b2ecb541aba4516734fdebd316">tempest-TestShelveInstance-615050191</nova:project>
Apr 14 13:28:29 user nova-compute[72019]:       </nova:owner>
Apr 14 13:28:29 user nova-compute[72019]:       <nova:ports>
Apr 14 13:28:29 user nova-compute[72019]:         <nova:port uuid="2a3ecee8-e3fc-433e-81d5-f0c9decfd248">
Apr 14 13:28:29 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 13:28:29 user nova-compute[72019]:         </nova:port>
Apr 14 13:28:29 user nova-compute[72019]:       </nova:ports>
Apr 14 13:28:29 user nova-compute[72019]:     </nova:instance>
Apr 14 13:28:29 user nova-compute[72019]:   </metadata>
Apr 14 13:28:29 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:28:29 user nova-compute[72019]:     <system>
Apr 14 13:28:29 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:28:29 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:28:29 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:28:29 user nova-compute[72019]:       <entry name="serial">04cf64b3-e51b-418f-94f6-7597c4cd74bb</entry>
Apr 14 13:28:29 user nova-compute[72019]:       <entry name="uuid">04cf64b3-e51b-418f-94f6-7597c4cd74bb</entry>
Apr 14 13:28:29 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:28:29 user nova-compute[72019]:     </system>
Apr 14 13:28:29 user nova-compute[72019]:   </sysinfo>
Apr 14 13:28:29 user nova-compute[72019]:   <os>
Apr 14 13:28:29 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:28:29 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:28:29 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:28:29 user nova-compute[72019]:   </os>
Apr 14 13:28:29 user nova-compute[72019]:   <features>
Apr 14 13:28:29 user nova-compute[72019]:     <acpi/>
Apr 14 13:28:29 user nova-compute[72019]:     <apic/>
Apr 14 13:28:29 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:28:29 user nova-compute[72019]:   </features>
Apr 14 13:28:29 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:28:29 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:28:29 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:28:29 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:28:29 user nova-compute[72019]:   </clock>
Apr 14 13:28:29 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:28:29 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:28:29 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:28:29 user nova-compute[72019]:   </cpu>
Apr 14 13:28:29 user nova-compute[72019]:   <devices>
Apr 14 13:28:29 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:28:29 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:28:29 user nova-compute[72019]:       <source dev="/dev/sde"/>
Apr 14 13:28:29 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:28:29 user nova-compute[72019]:       <serial>2724b817-0ad1-4678-9429-3f4e67a0f590</serial>
Apr 14 13:28:29 user nova-compute[72019]:     </disk>
Apr 14 13:28:29 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:28:29 user nova-compute[72019]:       <mac address="fa:16:3e:ad:c4:3d"/>
Apr 14 13:28:29 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:28:29 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:28:29 user nova-compute[72019]:       <target dev="tap2a3ecee8-e3"/>
Apr 14 13:28:29 user nova-compute[72019]:     </interface>
Apr 14 13:28:29 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:28:29 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/04cf64b3-e51b-418f-94f6-7597c4cd74bb/console.log" append="off"/>
Apr 14 13:28:29 user nova-compute[72019]:     </serial>
Apr 14 13:28:29 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:28:29 user nova-compute[72019]:     <video>
Apr 14 13:28:29 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:28:29 user nova-compute[72019]:     </video>
Apr 14 13:28:29 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:28:29 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:28:29 user nova-compute[72019]:     </rng>
Apr 14 13:28:29 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:28:29 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:28:29 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:28:29 user nova-compute[72019]:     </memballoon>
Apr 14 13:28:29 user nova-compute[72019]:   </devices>
Apr 14 13:28:29 user nova-compute[72019]: </domain>
Apr 14 13:28:29 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-548766851',display_name='tempest-TestShelveInstance-server-548766851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-548766851',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIS8eIL/I3kxODqxFDmjVZgbwaBnYYyEpymoIT8frdOJIbK3dXh9J9GGKAL9gBIvS+6clwDRwZVCayK/ppHQaSnk+tDF7XA0oMOuQgWly6j9ws3NqPQ/uDU7zZbqKPJbIA==',key_name='tempest-TestShelveInstance-1155531040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ba9f3b2ecb541aba4516734fdebd316',ramdisk_id='',reservation_id='r-6bf35sr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-615050191',owner_user_name='tempest-TestShelveInstance-615050191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:28:22Z,user_data=None,user_id='01b25b886ade4e6ea689010d655d99a0',uuid=04cf64b3-e51b-418f-94f6-7597c4cd74bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Converting VIF {"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c4:3d,bridge_name='br-int',has_traffic_filtering=True,id=2a3ecee8-e3fc-433e-81d5-f0c9decfd248,network=Network(0a7d4ddd-e535-4d06-a605-a34d3ef8188c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3ecee8-e3') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG os_vif [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c4:3d,bridge_name='br-int',has_traffic_filtering=True,id=2a3ecee8-e3fc-433e-81d5-f0c9decfd248,network=Network(0a7d4ddd-e535-4d06-a605-a34d3ef8188c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3ecee8-e3') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a3ecee8-e3, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a3ecee8-e3, col_values=(('external_ids', {'iface-id': '2a3ecee8-e3fc-433e-81d5-f0c9decfd248', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:c4:3d', 'vm-uuid': '04cf64b3-e51b-418f-94f6-7597c4cd74bb'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:29 user nova-compute[72019]: INFO os_vif [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c4:3d,bridge_name='br-int',has_traffic_filtering=True,id=2a3ecee8-e3fc-433e-81d5-f0c9decfd248,network=Network(0a7d4ddd-e535-4d06-a605-a34d3ef8188c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3ecee8-e3')
Apr 14 13:28:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] No VIF found with MAC fa:16:3e:ad:c4:3d, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:28:29 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:28:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:28:30 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:28:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:28:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:28:30 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:28:31 user nova-compute[72019]: DEBUG nova.compute.manager [req-d78a5456-c717-4609-aeb4-36ed557af209 req-5aa4c5af-d101-478d-a9d8-7d0d309f929c service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d78a5456-c717-4609-aeb4-36ed557af209 req-5aa4c5af-d101-478d-a9d8-7d0d309f929c service nova] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d78a5456-c717-4609-aeb4-36ed557af209 req-5aa4c5af-d101-478d-a9d8-7d0d309f929c service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d78a5456-c717-4609-aeb4-36ed557af209 req-5aa4c5af-d101-478d-a9d8-7d0d309f929c service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:31 user nova-compute[72019]: DEBUG nova.compute.manager [req-d78a5456-c717-4609-aeb4-36ed557af209 req-5aa4c5af-d101-478d-a9d8-7d0d309f929c service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] No waiting events found dispatching network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:31 user nova-compute[72019]: WARNING nova.compute.manager [req-d78a5456-c717-4609-aeb4-36ed557af209 req-5aa4c5af-d101-478d-a9d8-7d0d309f929c service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received unexpected event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance with vm_state building and task_state spawning.
Apr 14 13:28:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:31 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Updating instance_info_cache with network_info: [{"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:28:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-cc4631eb-ae5b-4efa-9def-c0c45f56f40f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:28:31 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:28:31 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:28:31 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:28:31 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:28:32 user nova-compute[72019]: WARNING nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid cc4631eb-ae5b-4efa-9def-c0c45f56f40f {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 978f6fc8-1080-4840-ab8a-e025efe4f906 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid b7cdf352-a517-4296-bc70-400836915095 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 82d3b319-f069-48b6-bb53-32835bc6a2e3 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 911be82f-bcf1-4b02-a218-ab977b28afe1 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 31781f5a-460a-41e3-bdcf-9cb20f050ba3 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 9970f98b-ade9-4d08-a88d-b11a222adcf9 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 626abaa0-3f53-42cc-978e-21f0a80232fa {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid 04cf64b3-e51b-418f-94f6-7597c4cd74bb {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "978f6fc8-1080-4840-ab8a-e025efe4f906" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "b7cdf352-a517-4296-bc70-400836915095" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "82d3b319-f069-48b6-bb53-32835bc6a2e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "911be82f-bcf1-4b02-a218-ab977b28afe1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478912.9075124, 04cf64b3-e51b-418f-94f6-7597c4cd74bb => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:28:32 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] VM Resumed (Lifecycle Event)
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "b7cdf352-a517-4296-bc70-400836915095" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:32 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Instance spawned successfully.
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:28:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:33 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478912.911034, 04cf64b3-e51b-418f-94f6-7597c4cd74bb => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:28:33 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] VM Started (Lifecycle Event)
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:28:33 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Creating image(s)
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Ensure instance console log exists: /opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Start _get_guest_xml network_info=[{"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '597f8f8d-f3ff-45ab-94b5-edc0311bd571', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcFLujaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '626abaa0-3f53-42cc-978e-21f0a80232fa', 'attached_at': '', 'detached_at': '', 'volume_id': '4e65ce2e-31ed-49fb-81e0-dd8f8e767272', 'serial': '4e65ce2e-31ed-49fb-81e0-dd8f8e767272'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.147s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:28:33 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:28:33 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcFLujaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:28:33 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:28:33 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:28:33 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:28:33 user nova-compute[72019]: INFO nova.compute.manager [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Took 5.43 seconds to spawn the instance on the hypervisor.
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed08352f-ff11-409c-a34e-0f82828c5f3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:28:33 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:33 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5072a7-fdaf-4eea-a84e-634bed7840a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272] added
Apr 14 13:28:33 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62251be-16e5-4dcf-b489-fa7774662b5f]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:33 user nova-compute[72019]: INFO nova.compute.manager [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Took 11.91 seconds to build instance.
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3519e326-88b0-4e85-84bc-eac3fbcbbda6]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JcFLujaY {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.030s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.313s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:33 user nova-compute[72019]: INFO nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JcFLujaY" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4c00ab-031a-463c-b23e-5fc55fecdafa]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JcFLujaY'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d832c58-310b-4a81-a221-a0e687303fc4]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[167c0f18-5234-4b19-9601-d0d53e84863b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:33 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:33 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:33 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:28:33 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:33 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:33 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:33 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:28:33 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-01c4f6d6-fd1b-4531-9a4f-5b3307fe7643 req-b3f29b06-5c5e-4405-822d-0feefdd83453 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01c4f6d6-fd1b-4531-9a4f-5b3307fe7643 req-b3f29b06-5c5e-4405-822d-0feefdd83453 service nova] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01c4f6d6-fd1b-4531-9a4f-5b3307fe7643 req-b3f29b06-5c5e-4405-822d-0feefdd83453 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-01c4f6d6-fd1b-4531-9a4f-5b3307fe7643 req-b3f29b06-5c5e-4405-822d-0feefdd83453 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-01c4f6d6-fd1b-4531-9a4f-5b3307fe7643 req-b3f29b06-5c5e-4405-822d-0feefdd83453 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] No waiting events found dispatching network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:33 user nova-compute[72019]: WARNING nova.compute.manager [req-01c4f6d6-fd1b-4531-9a4f-5b3307fe7643 req-b3f29b06-5c5e-4405-822d-0feefdd83453 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received unexpected event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance with vm_state active and task_state None.
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[662421ca-e6e6-45aa-9bf0-27a0eb0f7a09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272, portal: 172.16.0.220,3260]
Apr 14 13:28:33 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272, portal: 172.16.0.220,3260] successful.
Apr 14 13:28:33 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ed658a-b4d3-448c-9370-c14e277cb70a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0e589d-6f3a-4beb-aa38-22331acd30dc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:33 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:33 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:33 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:28:33 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:28:33 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:33 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:33 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:33 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:28:33 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:28:33 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b945aa-b4bb-442a-b5c4-68db7562d0d3]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcFLujaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:28:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23363363761323831', 'path': '/dev/sdf'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363363761323831', 'path': '/dev/sdf'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1217180291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1217180291',id=39,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a573d19b775642bba2f2883e0005492d',ramdisk_id='',reservation_id='r-0hfp37ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-740277424',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:28:22Z,user_data=None,user_id='ebc2d46bc1794568841df20b046356c7',uuid=626abaa0-3f53-42cc-978e-21f0a80232fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converting VIF {"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:18,bridge_name='br-int',has_traffic_filtering=True,id=7d5d9e2b-b502-494a-ac52-70930eda92ac,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5d9e2b-b5') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'pci_devices' on Instance uuid 626abaa0-3f53-42cc-978e-21f0a80232fa {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:28:34 user nova-compute[72019]:   <uuid>626abaa0-3f53-42cc-978e-21f0a80232fa</uuid>
Apr 14 13:28:34 user nova-compute[72019]:   <name>instance-00000027</name>
Apr 14 13:28:34 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:28:34 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:28:34 user nova-compute[72019]:   <metadata>
Apr 14 13:28:34 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:28:34 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:28:34 user nova-compute[72019]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1217180291</nova:name>
Apr 14 13:28:34 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:28:33</nova:creationTime>
Apr 14 13:28:34 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:28:34 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:28:34 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:28:34 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:28:34 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:28:34 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:28:34 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:28:34 user nova-compute[72019]:       <nova:owner>
Apr 14 13:28:34 user nova-compute[72019]:         <nova:user uuid="ebc2d46bc1794568841df20b046356c7">tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member</nova:user>
Apr 14 13:28:34 user nova-compute[72019]:         <nova:project uuid="a573d19b775642bba2f2883e0005492d">tempest-ServerBootFromVolumeStableRescueTest-740277424</nova:project>
Apr 14 13:28:34 user nova-compute[72019]:       </nova:owner>
Apr 14 13:28:34 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:28:34 user nova-compute[72019]:       <nova:ports>
Apr 14 13:28:34 user nova-compute[72019]:         <nova:port uuid="7d5d9e2b-b502-494a-ac52-70930eda92ac">
Apr 14 13:28:34 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 13:28:34 user nova-compute[72019]:         </nova:port>
Apr 14 13:28:34 user nova-compute[72019]:       </nova:ports>
Apr 14 13:28:34 user nova-compute[72019]:     </nova:instance>
Apr 14 13:28:34 user nova-compute[72019]:   </metadata>
Apr 14 13:28:34 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:28:34 user nova-compute[72019]:     <system>
Apr 14 13:28:34 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:28:34 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:28:34 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:28:34 user nova-compute[72019]:       <entry name="serial">626abaa0-3f53-42cc-978e-21f0a80232fa</entry>
Apr 14 13:28:34 user nova-compute[72019]:       <entry name="uuid">626abaa0-3f53-42cc-978e-21f0a80232fa</entry>
Apr 14 13:28:34 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:28:34 user nova-compute[72019]:     </system>
Apr 14 13:28:34 user nova-compute[72019]:   </sysinfo>
Apr 14 13:28:34 user nova-compute[72019]:   <os>
Apr 14 13:28:34 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:28:34 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:28:34 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:28:34 user nova-compute[72019]:   </os>
Apr 14 13:28:34 user nova-compute[72019]:   <features>
Apr 14 13:28:34 user nova-compute[72019]:     <acpi/>
Apr 14 13:28:34 user nova-compute[72019]:     <apic/>
Apr 14 13:28:34 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:28:34 user nova-compute[72019]:   </features>
Apr 14 13:28:34 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:28:34 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:28:34 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:28:34 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:28:34 user nova-compute[72019]:   </clock>
Apr 14 13:28:34 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:28:34 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:28:34 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:28:34 user nova-compute[72019]:   </cpu>
Apr 14 13:28:34 user nova-compute[72019]:   <devices>
Apr 14 13:28:34 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:28:34 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:28:34 user nova-compute[72019]:       <source dev="/dev/sdf"/>
Apr 14 13:28:34 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:28:34 user nova-compute[72019]:       <serial>4e65ce2e-31ed-49fb-81e0-dd8f8e767272</serial>
Apr 14 13:28:34 user nova-compute[72019]:     </disk>
Apr 14 13:28:34 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:28:34 user nova-compute[72019]:       <mac address="fa:16:3e:15:c3:18"/>
Apr 14 13:28:34 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:28:34 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:28:34 user nova-compute[72019]:       <target dev="tap7d5d9e2b-b5"/>
Apr 14 13:28:34 user nova-compute[72019]:     </interface>
Apr 14 13:28:34 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:28:34 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/console.log" append="off"/>
Apr 14 13:28:34 user nova-compute[72019]:     </serial>
Apr 14 13:28:34 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:28:34 user nova-compute[72019]:     <video>
Apr 14 13:28:34 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:28:34 user nova-compute[72019]:     </video>
Apr 14 13:28:34 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:28:34 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:28:34 user nova-compute[72019]:     </rng>
Apr 14 13:28:34 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:28:34 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:28:34 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:28:34 user nova-compute[72019]:     </memballoon>
Apr 14 13:28:34 user nova-compute[72019]:   </devices>
Apr 14 13:28:34 user nova-compute[72019]: </domain>
Apr 14 13:28:34 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1217180291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1217180291',id=39,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a573d19b775642bba2f2883e0005492d',ramdisk_id='',reservation_id='r-0hfp37ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-740277424',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:28:22Z,user_data=None,user_id='ebc2d46bc1794568841df20b046356c7',uuid=626abaa0-3f53-42cc-978e-21f0a80232fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converting VIF {"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:18,bridge_name='br-int',has_traffic_filtering=True,id=7d5d9e2b-b502-494a-ac52-70930eda92ac,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5d9e2b-b5') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG os_vif [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:18,bridge_name='br-int',has_traffic_filtering=True,id=7d5d9e2b-b502-494a-ac52-70930eda92ac,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5d9e2b-b5') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d5d9e2b-b5, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d5d9e2b-b5, col_values=(('external_ids', {'iface-id': '7d5d9e2b-b502-494a-ac52-70930eda92ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:c3:18', 'vm-uuid': '626abaa0-3f53-42cc-978e-21f0a80232fa'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:34 user nova-compute[72019]: INFO os_vif [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:18,bridge_name='br-int',has_traffic_filtering=True,id=7d5d9e2b-b502-494a-ac52-70930eda92ac,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5d9e2b-b5')
Apr 14 13:28:34 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:28:34 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] No VIF found with MAC fa:16:3e:15:c3:18, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:28:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-1d75973b-7ad3-43a3-8cdf-61a8ba291a76 req-16ade7b0-1531-4673-9600-8c3c9257afbe service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1d75973b-7ad3-43a3-8cdf-61a8ba291a76 req-16ade7b0-1531-4673-9600-8c3c9257afbe service nova] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1d75973b-7ad3-43a3-8cdf-61a8ba291a76 req-16ade7b0-1531-4673-9600-8c3c9257afbe service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1d75973b-7ad3-43a3-8cdf-61a8ba291a76 req-16ade7b0-1531-4673-9600-8c3c9257afbe service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-1d75973b-7ad3-43a3-8cdf-61a8ba291a76 req-16ade7b0-1531-4673-9600-8c3c9257afbe service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] No waiting events found dispatching network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:36 user nova-compute[72019]: WARNING nova.compute.manager [req-1d75973b-7ad3-43a3-8cdf-61a8ba291a76 req-16ade7b0-1531-4673-9600-8c3c9257afbe service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received unexpected event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac for instance with vm_state building and task_state spawning.
Apr 14 13:28:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:28:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG nova.compute.manager [req-d097b14c-dab8-41a7-936d-9b4240073346 req-8b02502f-0a18-469f-a9bc-495487a96336 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d097b14c-dab8-41a7-936d-9b4240073346 req-8b02502f-0a18-469f-a9bc-495487a96336 service nova] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d097b14c-dab8-41a7-936d-9b4240073346 req-8b02502f-0a18-469f-a9bc-495487a96336 service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d097b14c-dab8-41a7-936d-9b4240073346 req-8b02502f-0a18-469f-a9bc-495487a96336 service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:38 user nova-compute[72019]: DEBUG nova.compute.manager [req-d097b14c-dab8-41a7-936d-9b4240073346 req-8b02502f-0a18-469f-a9bc-495487a96336 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] No waiting events found dispatching network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:38 user nova-compute[72019]: WARNING nova.compute.manager [req-d097b14c-dab8-41a7-936d-9b4240073346 req-8b02502f-0a18-469f-a9bc-495487a96336 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received unexpected event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac for instance with vm_state building and task_state spawning.
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478919.073692, 626abaa0-3f53-42cc-978e-21f0a80232fa => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:28:39 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] VM Resumed (Lifecycle Event)
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:28:39 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Instance spawned successfully.
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:28:39 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478919.0814488, 626abaa0-3f53-42cc-978e-21f0a80232fa => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:28:39 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] VM Started (Lifecycle Event)
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:28:39 user nova-compute[72019]: INFO nova.compute.manager [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Terminating instance
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:39 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:28:39 user nova-compute[72019]: INFO nova.compute.manager [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Took 6.26 seconds to spawn the instance on the hypervisor.
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:39 user nova-compute[72019]: INFO nova.compute.manager [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Took 18.61 seconds to build instance.
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.789s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.583s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:39 user nova-compute[72019]: INFO nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-4efaf3e9-de81-418a-bdb4-aa7a981a1c0e req-f4cfb197-64bf-4e34-91d8-262a22cc0e82 service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received event network-vif-unplugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4efaf3e9-de81-418a-bdb4-aa7a981a1c0e req-f4cfb197-64bf-4e34-91d8-262a22cc0e82 service nova] Acquiring lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4efaf3e9-de81-418a-bdb4-aa7a981a1c0e req-f4cfb197-64bf-4e34-91d8-262a22cc0e82 service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4efaf3e9-de81-418a-bdb4-aa7a981a1c0e req-f4cfb197-64bf-4e34-91d8-262a22cc0e82 service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-4efaf3e9-de81-418a-bdb4-aa7a981a1c0e req-f4cfb197-64bf-4e34-91d8-262a22cc0e82 service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] No waiting events found dispatching network-vif-unplugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-4efaf3e9-de81-418a-bdb4-aa7a981a1c0e req-f4cfb197-64bf-4e34-91d8-262a22cc0e82 service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received event network-vif-unplugged-d5720602-747e-4fff-8334-2412fa184f73 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:40 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:28:40 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7792MB free_disk=26.022899627685547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:40 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Instance destroyed successfully.
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.objects.instance [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'resources' on Instance uuid cc4631eb-ae5b-4efa-9def-c0c45f56f40f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1383992809',display_name='tempest-ServerRescueNegativeTestJSON-server-1383992809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1383992809',id=4,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:14:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7c8c8f620334166a141ea65525ba2a0',ramdisk_id='',reservation_id='r-7zkpx5xm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1698214771',owner_user_name='tempest-ServerRescueNegativeTestJSON-1698214771-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:14:30Z,user_data=None,user_id='3948b7c643374bcdbeb34f0f2f790c3c',uuid=cc4631eb-ae5b-4efa-9def-c0c45f56f40f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converting VIF {"id": "d5720602-747e-4fff-8334-2412fa184f73", "address": "fa:16:3e:d4:cc:9c", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5720602-74", "ovs_interfaceid": "d5720602-747e-4fff-8334-2412fa184f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:cc:9c,bridge_name='br-int',has_traffic_filtering=True,id=d5720602-747e-4fff-8334-2412fa184f73,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5720602-74') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG os_vif [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:cc:9c,bridge_name='br-int',has_traffic_filtering=True,id=d5720602-747e-4fff-8334-2412fa184f73,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5720602-74') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5720602-74, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:28:40 user nova-compute[72019]: INFO os_vif [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:cc:9c,bridge_name='br-int',has_traffic_filtering=True,id=d5720602-747e-4fff-8334-2412fa184f73,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5720602-74')
Apr 14 13:28:40 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Deleting instance files /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f_del
Apr 14 13:28:40 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Deletion of /opt/stack/data/nova/instances/cc4631eb-ae5b-4efa-9def-c0c45f56f40f_del complete
Apr 14 13:28:40 user nova-compute[72019]: INFO nova.compute.manager [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Took 1.56 seconds to destroy the instance on the hypervisor.
Apr 14 13:28:40 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 626abaa0-3f53-42cc-978e-21f0a80232fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:28:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing inventories for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Updating ProviderTree inventory for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Updating inventory in ProviderTree for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing aggregate associations for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569, aggregates: None {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing trait associations for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:28:41 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Took 0.63 seconds to deallocate network for instance.
Apr 14 13:28:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-a18977c1-caa2-413e-aa72-e858958f555a req-88b8f782-19cf-4a3d-8a95-1443f96a09ae service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received event network-vif-deleted-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.959s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.105s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72019) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-453248e8-fc35-49b1-8916-78625d970651 req-dcc1bdbb-0a93-441c-a2a6-587e44b1f96d service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received event network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-453248e8-fc35-49b1-8916-78625d970651 req-dcc1bdbb-0a93-441c-a2a6-587e44b1f96d service nova] Acquiring lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-453248e8-fc35-49b1-8916-78625d970651 req-dcc1bdbb-0a93-441c-a2a6-587e44b1f96d service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-453248e8-fc35-49b1-8916-78625d970651 req-dcc1bdbb-0a93-441c-a2a6-587e44b1f96d service nova] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:41 user nova-compute[72019]: DEBUG nova.compute.manager [req-453248e8-fc35-49b1-8916-78625d970651 req-dcc1bdbb-0a93-441c-a2a6-587e44b1f96d service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] No waiting events found dispatching network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:41 user nova-compute[72019]: WARNING nova.compute.manager [req-453248e8-fc35-49b1-8916-78625d970651 req-dcc1bdbb-0a93-441c-a2a6-587e44b1f96d service nova] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Received unexpected event network-vif-plugged-d5720602-747e-4fff-8334-2412fa184f73 for instance with vm_state deleted and task_state None.
Apr 14 13:28:41 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:28:42 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:28:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:42 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Deleted allocations for instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f
Apr 14 13:28:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "cc4631eb-ae5b-4efa-9def-c0c45f56f40f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.948s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-ff8105a9-0f43-41e0-8604-dfd62ed09b1e req-9a7384f8-eaad-42b5-9564-01d85e994cdc service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Received event network-changed-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-ff8105a9-0f43-41e0-8604-dfd62ed09b1e req-9a7384f8-eaad-42b5-9564-01d85e994cdc service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Refreshing instance network info cache due to event network-changed-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:28:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ff8105a9-0f43-41e0-8604-dfd62ed09b1e req-9a7384f8-eaad-42b5-9564-01d85e994cdc service nova] Acquiring lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:28:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ff8105a9-0f43-41e0-8604-dfd62ed09b1e req-9a7384f8-eaad-42b5-9564-01d85e994cdc service nova] Acquired lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:28:43 user nova-compute[72019]: DEBUG nova.network.neutron [req-ff8105a9-0f43-41e0-8604-dfd62ed09b1e req-9a7384f8-eaad-42b5-9564-01d85e994cdc service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Refreshing network info cache for port c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lazy-loading 'flavor' on Instance uuid 31781f5a-460a-41e3-bdcf-9cb20f050ba3 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.207s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:44 user nova-compute[72019]: INFO nova.compute.manager [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Attaching volume 57e0498e-3dd2-4931-b8e8-bc188948fa24 to /dev/vdb
Apr 14 13:28:44 user nova-compute[72019]: DEBUG os_brick.utils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[873b6e8f-5ebd-459c-9676-e8b342abf12b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[193ab581-40f3-4f5c-a5a9-52eee3ffa2bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[39753e37-9b1a-4ba1-bb2b-c3c31ec8df82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d233052d-a34d-49c1-88b5-19ee3ccbccae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:28:44 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[86990b8c-6189-487a-a329-104f1a11ac23]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG os_brick.utils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Updating existing volume attachment record: 7db0f830-b1f6-4fd5-93d6-e4fbd466ea4f {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG nova.network.neutron [req-ff8105a9-0f43-41e0-8604-dfd62ed09b1e req-9a7384f8-eaad-42b5-9564-01d85e994cdc service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Updated VIF entry in instance network info cache for port c55e9150-0706-4fa7-9c0c-e94b7aefc8eb. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG nova.network.neutron [req-ff8105a9-0f43-41e0-8604-dfd62ed09b1e req-9a7384f8-eaad-42b5-9564-01d85e994cdc service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Updating instance_info_cache with network_info: [{"id": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "address": "fa:16:3e:af:84:dd", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55e9150-07", "ovs_interfaceid": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:28:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ff8105a9-0f43-41e0-8604-dfd62ed09b1e req-9a7384f8-eaad-42b5-9564-01d85e994cdc service nova] Releasing lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:28:45 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:28:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Cleaning up deleted instances {{(pid=72019) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 13:28:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] There are 0 instances to clean {{(pid=72019) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 13:28:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "82d3b319-f069-48b6-bb53-32835bc6a2e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:47 user nova-compute[72019]: INFO nova.compute.manager [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Terminating instance
Apr 14 13:28:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG nova.compute.manager [req-da8a8e22-e258-4675-a0ca-57760b55d0f2 req-51384781-2d28-4bad-8538-2a37105667db service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Received event network-vif-unplugged-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-da8a8e22-e258-4675-a0ca-57760b55d0f2 req-51384781-2d28-4bad-8538-2a37105667db service nova] Acquiring lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-da8a8e22-e258-4675-a0ca-57760b55d0f2 req-51384781-2d28-4bad-8538-2a37105667db service nova] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-da8a8e22-e258-4675-a0ca-57760b55d0f2 req-51384781-2d28-4bad-8538-2a37105667db service nova] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG nova.compute.manager [req-da8a8e22-e258-4675-a0ca-57760b55d0f2 req-51384781-2d28-4bad-8538-2a37105667db service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] No waiting events found dispatching network-vif-unplugged-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG nova.compute.manager [req-da8a8e22-e258-4675-a0ca-57760b55d0f2 req-51384781-2d28-4bad-8538-2a37105667db service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Received event network-vif-unplugged-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:28:48 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Instance destroyed successfully.
Apr 14 13:28:48 user nova-compute[72019]: DEBUG nova.objects.instance [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lazy-loading 'resources' on Instance uuid 82d3b319-f069-48b6-bb53-32835bc6a2e3 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1066264697',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1066264697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1066264697',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:24:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-p5quvd2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:24:20Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=82d3b319-f069-48b6-bb53-32835bc6a2e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "address": "fa:16:3e:7e:24:9e", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5b7a99-53", "ovs_interfaceid": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "address": "fa:16:3e:7e:24:9e", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5b7a99-53", "ovs_interfaceid": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:24:9e,bridge_name='br-int',has_traffic_filtering=True,id=6f5b7a99-53da-4ad1-b18a-d4b62d359e1b,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5b7a99-53') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG os_vif [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:24:9e,bridge_name='br-int',has_traffic_filtering=True,id=6f5b7a99-53da-4ad1-b18a-d4b62d359e1b,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5b7a99-53') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f5b7a99-53, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:48 user nova-compute[72019]: INFO os_vif [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:24:9e,bridge_name='br-int',has_traffic_filtering=True,id=6f5b7a99-53da-4ad1-b18a-d4b62d359e1b,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5b7a99-53')
Apr 14 13:28:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJdLctnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:28:48 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:28:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee7bf19-b64a-491c-a15b-a9dc2d86b612]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:28:48 user nova-compute[72019]: No targets found.
Apr 14 13:28:48 user nova-compute[72019]: iSNS:
Apr 14 13:28:48 user nova-compute[72019]: No targets found.
Apr 14 13:28:48 user nova-compute[72019]: STATIC:
Apr 14 13:28:48 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272
Apr 14 13:28:48 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:28:48 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:28:48 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:28:48 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:28:48 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:28:48 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590
Apr 14 13:28:48 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:28:48 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:28:48 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b
Apr 14 13:28:48 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:28:48 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:28:48 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29
Apr 14 13:28:48 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:28:48 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:28:48 user nova-compute[72019]: FIRMWARE:
Apr 14 13:28:48 user nova-compute[72019]: No targets found.
Apr 14 13:28:48 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:28:48 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:28:48 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf291cae-b880-4aa1-b219-dd96f9bf4394]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b60af9b-a19e-4b6a-98bb-b89e6cb26a23]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:48 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:48 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:48 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:28:48 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:28:48 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:48 user nova-compute[72019]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 (non-flash)
Apr 14 13:28:48 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:48 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:28:48 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:28:48 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74901c0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29'): ({'sdd'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Removing single pathed devices sdd {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d48864d-1b51-401d-9a05-9a07b3771a20]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e95292-0bdb-46a6-bb4b-e80086675cf7]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flushing IO for device /dev/sdd {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e8677f-ec9d-420f-81b7-b76651fe9bc8]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:28:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a35a53-c7b4-4d2a-b2b6-a49aaa6cb866]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] SCSI volumes sdd have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23664626638303232', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_da6f018f', '/dev/disk/by-id/scsi-1SCST_BIOda6f018f-6dbf802245e8642f') {{(pid=82397) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e895e627-b9c6-4c63-a5a1-92cc42913c9d]: (4, None) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a650b181-a98c-4424-b089-18c0b2f53d6d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[347c5de1-97d4-4023-bc08-ae50d90622c5]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29, portal: 172.16.0.220,3260]
Apr 14 13:28:49 user nova-compute[72019]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29, portal: 172.16.0.220,3260] successful.
Apr 14 13:28:49 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa06c410-d2f3-4211-98a9-d8bae7d21b29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e0c654-15dd-4614-92e0-ef9ea858dcf2]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== disconnect_volume: return (393ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:28:49 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Deleting instance files /opt/stack/data/nova/instances/82d3b319-f069-48b6-bb53-32835bc6a2e3_del
Apr 14 13:28:49 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Deletion of /opt/stack/data/nova/instances/82d3b319-f069-48b6-bb53-32835bc6a2e3_del complete
Apr 14 13:28:49 user nova-compute[72019]: INFO nova.compute.manager [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Took 1.27 seconds to destroy the instance on the hypervisor.
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeFbusiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:28:49 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:28:49 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:28:49 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[678f6d8a-ec68-4bda-b9b6-e9ef0b8ed59b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:28:49 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba2eb1e-f817-475b-aaaa-ebaa63d3d4af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24] added
Apr 14 13:28:49 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e149fcc4-10a8-48d5-99ea-d7845ca716c0]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e8c87f-064e-491e-b0cd-f27e961212f7]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MeFbusiH {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MeFbusiH" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac976bda-3cd9-4c44-a4b4-11995be7eb69]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MeFbusiH'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26175ad-8ed0-4395-b5ab-c0f5edb51232]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5382a281-e307-49bb-ace4-228be8361eff]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:49 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:49 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:28:49 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:28:49 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:49 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:49 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:28:49 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:28:49 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:28:49 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Took 0.71 seconds to deallocate network for instance.
Apr 14 13:28:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-9c987bf2-5466-4ee9-aa8b-5ca431433caa req-e67fc40f-34ba-459e-94fb-ab1359eea891 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Received event network-vif-deleted-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:49 user nova-compute[72019]: INFO nova.compute.manager [req-9c987bf2-5466-4ee9-aa8b-5ca431433caa req-e67fc40f-34ba-459e-94fb-ab1359eea891 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Neutron deleted interface 6f5b7a99-53da-4ad1-b18a-d4b62d359e1b; detaching it from the instance and deleting it from the info cache
Apr 14 13:28:49 user nova-compute[72019]: DEBUG nova.network.neutron [req-9c987bf2-5466-4ee9-aa8b-5ca431433caa req-e67fc40f-34ba-459e-94fb-ab1359eea891 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d7fd21-bed9-4311-809a-c9f547569617]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24, portal: 172.16.0.220,3260]
Apr 14 13:28:49 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24, portal: 172.16.0.220,3260] successful.
Apr 14 13:28:49 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-9c987bf2-5466-4ee9-aa8b-5ca431433caa req-e67fc40f-34ba-459e-94fb-ab1359eea891 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Detach interface failed, port_id=6f5b7a99-53da-4ad1-b18a-d4b62d359e1b, reason: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca080d0-3d41-4e75-90c3-d5ba3990d69f]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[45626e13-2d57-4db0-9c16-9c04d1b5874f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:50 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:50 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:28:50 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:28:50 user nova-compute[72019]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 (non-flash)
Apr 14 13:28:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:50 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:50 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:28:50 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:28:50 user nova-compute[72019]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 (non-flash)
Apr 14 13:28:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b88dcf2-bc4a-4666-8e8e-7946ab003139]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeFbusiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-43f62700-6a44-45df-81e5-91b3f3d860a4 req-ebe6977d-93bc-4676-88ad-04e26a69f478 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Received event network-vif-plugged-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-43f62700-6a44-45df-81e5-91b3f3d860a4 req-ebe6977d-93bc-4676-88ad-04e26a69f478 service nova] Acquiring lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-43f62700-6a44-45df-81e5-91b3f3d860a4 req-ebe6977d-93bc-4676-88ad-04e26a69f478 service nova] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-43f62700-6a44-45df-81e5-91b3f3d860a4 req-ebe6977d-93bc-4676-88ad-04e26a69f478 service nova] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-43f62700-6a44-45df-81e5-91b3f3d860a4 req-ebe6977d-93bc-4676-88ad-04e26a69f478 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] No waiting events found dispatching network-vif-plugged-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:28:50 user nova-compute[72019]: WARNING nova.compute.manager [req-43f62700-6a44-45df-81e5-91b3f3d860a4 req-ebe6977d-93bc-4676-88ad-04e26a69f478 service nova] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Received unexpected event network-vif-plugged-6f5b7a99-53da-4ad1-b18a-d4b62d359e1b for instance with vm_state active and task_state deleting.
Apr 14 13:28:50 user nova-compute[72019]: INFO nova.compute.manager [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Took 0.81 seconds to detach 1 volumes for instance.
Apr 14 13:28:50 user nova-compute[72019]: DEBUG nova.compute.manager [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Deleting volume: fa06c410-d2f3-4211-98a9-d8bae7d21b29 {{(pid=72019) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:28:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26133643164663739', 'path': '/dev/sdd'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:28:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133643164663739', 'path': '/dev/sdd'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:28:51 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lazy-loading 'flavor' on Instance uuid 31781f5a-460a-41e3-bdcf-9cb20f050ba3 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:28:51 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:28:51 user nova-compute[72019]:   <source dev="/dev/sdd"/>
Apr 14 13:28:51 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:28:51 user nova-compute[72019]:   <serial>57e0498e-3dd2-4931-b8e8-bc188948fa24</serial>
Apr 14 13:28:51 user nova-compute[72019]: </disk>
Apr 14 13:28:51 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:28:51 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:28:51 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:28:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:51 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Deleted allocations for instance 82d3b319-f069-48b6-bb53-32835bc6a2e3
Apr 14 13:28:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "82d3b319-f069-48b6-bb53-32835bc6a2e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.470s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:28:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:28:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] No VIF found with MAC fa:16:3e:af:84:dd, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:28:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.368s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:53 user nova-compute[72019]: INFO nova.compute.manager [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Detaching volume 57e0498e-3dd2-4931-b8e8-bc188948fa24
Apr 14 13:28:53 user nova-compute[72019]: INFO nova.virt.block_device [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Attempting to driver detach volume 57e0498e-3dd2-4931-b8e8-bc188948fa24 from mountpoint /dev/vdb
Apr 14 13:28:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Attempting to detach device vdb from instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:28:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:28:53 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:28:53 user nova-compute[72019]:   <source dev="/dev/sdd"/>
Apr 14 13:28:53 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:28:53 user nova-compute[72019]:   <serial>57e0498e-3dd2-4931-b8e8-bc188948fa24</serial>
Apr 14 13:28:53 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:28:53 user nova-compute[72019]: </disk>
Apr 14 13:28:53 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:28:53 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Successfully detached device vdb from instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 from the persistent domain config.
Apr 14 13:28:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:28:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:28:53 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:28:53 user nova-compute[72019]:   <source dev="/dev/sdd"/>
Apr 14 13:28:53 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:28:53 user nova-compute[72019]:   <serial>57e0498e-3dd2-4931-b8e8-bc188948fa24</serial>
Apr 14 13:28:53 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:28:53 user nova-compute[72019]: </disk>
Apr 14 13:28:53 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:28:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681478934.1545968, 31781f5a-460a-41e3-bdcf-9cb20f050ba3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:28:54 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Successfully detached device vdb from instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 from the live domain config.
Apr 14 13:28:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeFbusiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:28:54 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[75db9219-de3a-4b0f-99bd-480c2f0ed28b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:28:54 user nova-compute[72019]: No targets found.
Apr 14 13:28:54 user nova-compute[72019]: iSNS:
Apr 14 13:28:54 user nova-compute[72019]: No targets found.
Apr 14 13:28:54 user nova-compute[72019]: STATIC:
Apr 14 13:28:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272
Apr 14 13:28:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:28:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:28:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:28:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:28:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:28:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590
Apr 14 13:28:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:28:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:28:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24
Apr 14 13:28:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:28:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:28:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b
Apr 14 13:28:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:28:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:28:54 user nova-compute[72019]: FIRMWARE:
Apr 14 13:28:54 user nova-compute[72019]: No targets found.
Apr 14 13:28:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:28:54 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:28:54 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cd5643-6979-4c18-b1f8-49085889eac6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[390af331-4230-41f6-bb68-382ee0a3b75c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:54 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:54 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:28:54 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:28:54 user nova-compute[72019]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 (non-flash)
Apr 14 13:28:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:28:54 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:28:54 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:28:54 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:28:54 user nova-compute[72019]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 (non-flash)
Apr 14 13:28:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74905ca560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24'): ({'sdd'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Removing single pathed devices sdd {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0c042d-d805-408f-b378-a31ba6594314]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7d77ee-5af9-40f3-9d97-bc29790cf8d6]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Flushing IO for device /dev/sdd {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[523f1379-397a-4eeb-9558-7f81c9dcc24b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dfd633-ce31-4d0f-bfc9-aa5e232b46ec]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] SCSI volumes sdd have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac804c67-9ce3-4fc2-85ec-79fa86c52b67]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[41660e4f-1455-40af-b0b5-3e6cb0957e21]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24, portal: 172.16.0.220,3260]
Apr 14 13:28:54 user nova-compute[72019]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24, portal: 172.16.0.220,3260] successful.
Apr 14 13:28:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e0498e-3dd2-4931-b8e8-bc188948fa24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f20f64d-68d4-403a-84d2-b0e31767b562]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] <== disconnect_volume: return (337ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:28:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:28:55 user nova-compute[72019]: DEBUG nova.objects.instance [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lazy-loading 'flavor' on Instance uuid 31781f5a-460a-41e3-bdcf-9cb20f050ba3 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.852s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:55 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478920.1369338, cc4631eb-ae5b-4efa-9def-c0c45f56f40f => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:28:55 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] VM Stopped (Lifecycle Event)
Apr 14 13:28:55 user nova-compute[72019]: DEBUG nova.compute.manager [None req-973d7998-a8fe-45de-9e14-953e20a6dcc8 None None] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:28:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:57 user nova-compute[72019]: INFO nova.compute.manager [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Unshelving
Apr 14 13:28:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:57 user nova-compute[72019]: DEBUG nova.objects.instance [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'pci_requests' on Instance uuid f7df0d0b-535b-4a60-a050-ddd6449e3c4d {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:57 user nova-compute[72019]: DEBUG nova.objects.instance [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'numa_topology' on Instance uuid f7df0d0b-535b-4a60-a050-ddd6449e3c4d {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:57 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:28:57 user nova-compute[72019]: INFO nova.compute.claims [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Claim successful on node user
Apr 14 13:28:57 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:28:57 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:28:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:58 user nova-compute[72019]: INFO nova.network.neutron [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Updating port 3cf56142-3eb9-481f-9e81-b839a2106ab3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 13:28:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:28:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquired lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:28:58 user nova-compute[72019]: DEBUG nova.network.neutron [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:28:58 user nova-compute[72019]: DEBUG nova.compute.manager [req-f999e96d-aa03-4be6-bc1c-0df0053c2c0d req-58973ee9-0a5b-4d8f-ba4b-534fb8c2a151 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received event network-changed-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:28:58 user nova-compute[72019]: DEBUG nova.compute.manager [req-f999e96d-aa03-4be6-bc1c-0df0053c2c0d req-58973ee9-0a5b-4d8f-ba4b-534fb8c2a151 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Refreshing instance network info cache due to event network-changed-3cf56142-3eb9-481f-9e81-b839a2106ab3. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:28:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f999e96d-aa03-4be6-bc1c-0df0053c2c0d req-58973ee9-0a5b-4d8f-ba4b-534fb8c2a151 service nova] Acquiring lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:28:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:28:58 user nova-compute[72019]: DEBUG nova.network.neutron [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Updating instance_info_cache with network_info: [{"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:28:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Releasing lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:28:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:28:59 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Creating image(s)
Apr 14 13:28:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "/opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "/opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:28:59 user nova-compute[72019]: DEBUG nova.objects.instance [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'trusted_certs' on Instance uuid f7df0d0b-535b-4a60-a050-ddd6449e3c4d {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:28:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f999e96d-aa03-4be6-bc1c-0df0053c2c0d req-58973ee9-0a5b-4d8f-ba4b-534fb8c2a151 service nova] Acquired lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:28:59 user nova-compute[72019]: DEBUG nova.network.neutron [req-f999e96d-aa03-4be6-bc1c-0df0053c2c0d req-58973ee9-0a5b-4d8f-ba4b-534fb8c2a151 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Refreshing network info cache for port 3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:28:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "afbe2c601a4eb71cfb2aa564218b1b765b119885" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:28:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "afbe2c601a4eb71cfb2aa564218b1b765b119885" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:28:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885.part --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:28:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885.part --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:28:59 user nova-compute[72019]: DEBUG nova.virt.images [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 4f68a37c-6f0b-4856-8726-572c25db2b8d was qcow2, converting to raw {{(pid=72019) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 13:28:59 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:28:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885.part /opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885.converted {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG nova.network.neutron [req-f999e96d-aa03-4be6-bc1c-0df0053c2c0d req-58973ee9-0a5b-4d8f-ba4b-534fb8c2a151 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Updated VIF entry in instance network info cache for port 3cf56142-3eb9-481f-9e81-b839a2106ab3. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG nova.network.neutron [req-f999e96d-aa03-4be6-bc1c-0df0053c2c0d req-58973ee9-0a5b-4d8f-ba4b-534fb8c2a151 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Updating instance_info_cache with network_info: [{"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f999e96d-aa03-4be6-bc1c-0df0053c2c0d req-58973ee9-0a5b-4d8f-ba4b-534fb8c2a151 service nova] Releasing lock "refresh_cache-f7df0d0b-535b-4a60-a050-ddd6449e3c4d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885.part /opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885.converted" returned: 0 in 0.510s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885.converted --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "afbe2c601a4eb71cfb2aa564218b1b765b119885" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.585s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885 --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885 --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "afbe2c601a4eb71cfb2aa564218b1b765b119885" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "afbe2c601a4eb71cfb2aa564218b1b765b119885" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885 --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885 --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885,backing_fmt=raw /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885,backing_fmt=raw /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk 1073741824" returned: 0 in 0.048s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "afbe2c601a4eb71cfb2aa564218b1b765b119885" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885 --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afbe2c601a4eb71cfb2aa564218b1b765b119885 --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:01 user nova-compute[72019]: DEBUG nova.objects.instance [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'migration_context' on Instance uuid f7df0d0b-535b-4a60-a050-ddd6449e3c4d {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:29:01 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Rebasing disk image.
Apr 14 13:29:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.153s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:01 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d -F raw /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d -F raw /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk" returned: 0 in 2.081s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Ensure instance console log exists: /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Start _get_guest_xml network_info=[{"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='54a95eec92ebd90c3aed1160f0aac8b9',container_format='bare',created_at=2023-04-14T13:27:04Z,direct_url=<?>,disk_format='qcow2',id=4f68a37c-6f0b-4856-8726-572c25db2b8d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1289054872-shelved',owner='8f0fee50983a4e31b1689dc77b1c4db1',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T13:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:29:03 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:29:03 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='54a95eec92ebd90c3aed1160f0aac8b9',container_format='bare',created_at=2023-04-14T13:27:04Z,direct_url=<?>,disk_format='qcow2',id=4f68a37c-6f0b-4856-8726-572c25db2b8d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1289054872-shelved',owner='8f0fee50983a4e31b1689dc77b1c4db1',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T13:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.objects.instance [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'vcpu_model' on Instance uuid f7df0d0b-535b-4a60-a050-ddd6449e3c4d {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1289054872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1289054872',id=34,image_ref='4f68a37c-6f0b-4856-8726-572c25db2b8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-321023180',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:25:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8f0fee50983a4e31b1689dc77b1c4db1',ramdisk_id='',reservation_id='r-vz8bjy3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1344633518',owner_user_name='tempest-AttachVolumeShelveTestJSON-1344633518-project-member',shelved_at='2023-04-14T13:27:08.558881',shelved_host='user',shelved_image_id='4f68a37c-6f0b-4856-8726-572c25db2b8d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04370605aec40a0a53a080c1e8bf8a8',uuid=f7df0d0b-535b-4a60-a050-ddd6449e3c4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converting VIF {"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ff:1f,bridge_name='br-int',has_traffic_filtering=True,id=3cf56142-3eb9-481f-9e81-b839a2106ab3,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf56142-3e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.objects.instance [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'pci_devices' on Instance uuid f7df0d0b-535b-4a60-a050-ddd6449e3c4d {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:29:03 user nova-compute[72019]:   <uuid>f7df0d0b-535b-4a60-a050-ddd6449e3c4d</uuid>
Apr 14 13:29:03 user nova-compute[72019]:   <name>instance-00000022</name>
Apr 14 13:29:03 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:29:03 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:29:03 user nova-compute[72019]:   <metadata>
Apr 14 13:29:03 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:29:03 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:29:03 user nova-compute[72019]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1289054872</nova:name>
Apr 14 13:29:03 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:29:03</nova:creationTime>
Apr 14 13:29:03 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:29:03 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:29:03 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:29:03 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:29:03 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:29:03 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:29:03 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:29:03 user nova-compute[72019]:       <nova:owner>
Apr 14 13:29:03 user nova-compute[72019]:         <nova:user uuid="f04370605aec40a0a53a080c1e8bf8a8">tempest-AttachVolumeShelveTestJSON-1344633518-project-member</nova:user>
Apr 14 13:29:03 user nova-compute[72019]:         <nova:project uuid="8f0fee50983a4e31b1689dc77b1c4db1">tempest-AttachVolumeShelveTestJSON-1344633518</nova:project>
Apr 14 13:29:03 user nova-compute[72019]:       </nova:owner>
Apr 14 13:29:03 user nova-compute[72019]:       <nova:root type="image" uuid="4f68a37c-6f0b-4856-8726-572c25db2b8d"/>
Apr 14 13:29:03 user nova-compute[72019]:       <nova:ports>
Apr 14 13:29:03 user nova-compute[72019]:         <nova:port uuid="3cf56142-3eb9-481f-9e81-b839a2106ab3">
Apr 14 13:29:03 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 13:29:03 user nova-compute[72019]:         </nova:port>
Apr 14 13:29:03 user nova-compute[72019]:       </nova:ports>
Apr 14 13:29:03 user nova-compute[72019]:     </nova:instance>
Apr 14 13:29:03 user nova-compute[72019]:   </metadata>
Apr 14 13:29:03 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:29:03 user nova-compute[72019]:     <system>
Apr 14 13:29:03 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:29:03 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:29:03 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:29:03 user nova-compute[72019]:       <entry name="serial">f7df0d0b-535b-4a60-a050-ddd6449e3c4d</entry>
Apr 14 13:29:03 user nova-compute[72019]:       <entry name="uuid">f7df0d0b-535b-4a60-a050-ddd6449e3c4d</entry>
Apr 14 13:29:03 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:29:03 user nova-compute[72019]:     </system>
Apr 14 13:29:03 user nova-compute[72019]:   </sysinfo>
Apr 14 13:29:03 user nova-compute[72019]:   <os>
Apr 14 13:29:03 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:29:03 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:29:03 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:29:03 user nova-compute[72019]:   </os>
Apr 14 13:29:03 user nova-compute[72019]:   <features>
Apr 14 13:29:03 user nova-compute[72019]:     <acpi/>
Apr 14 13:29:03 user nova-compute[72019]:     <apic/>
Apr 14 13:29:03 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:29:03 user nova-compute[72019]:   </features>
Apr 14 13:29:03 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:29:03 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:29:03 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:29:03 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:29:03 user nova-compute[72019]:   </clock>
Apr 14 13:29:03 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:29:03 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:29:03 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:29:03 user nova-compute[72019]:   </cpu>
Apr 14 13:29:03 user nova-compute[72019]:   <devices>
Apr 14 13:29:03 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:29:03 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:29:03 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk"/>
Apr 14 13:29:03 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:29:03 user nova-compute[72019]:     </disk>
Apr 14 13:29:03 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:29:03 user nova-compute[72019]:       <mac address="fa:16:3e:d2:ff:1f"/>
Apr 14 13:29:03 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:29:03 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:29:03 user nova-compute[72019]:       <target dev="tap3cf56142-3e"/>
Apr 14 13:29:03 user nova-compute[72019]:     </interface>
Apr 14 13:29:03 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:29:03 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/console.log" append="off"/>
Apr 14 13:29:03 user nova-compute[72019]:     </serial>
Apr 14 13:29:03 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:29:03 user nova-compute[72019]:     <video>
Apr 14 13:29:03 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:29:03 user nova-compute[72019]:     </video>
Apr 14 13:29:03 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:29:03 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:29:03 user nova-compute[72019]:     </rng>
Apr 14 13:29:03 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:29:03 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:29:03 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:29:03 user nova-compute[72019]:     </memballoon>
Apr 14 13:29:03 user nova-compute[72019]:   </devices>
Apr 14 13:29:03 user nova-compute[72019]: </domain>
Apr 14 13:29:03 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1289054872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1289054872',id=34,image_ref='4f68a37c-6f0b-4856-8726-572c25db2b8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-321023180',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:25:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8f0fee50983a4e31b1689dc77b1c4db1',ramdisk_id='',reservation_id='r-vz8bjy3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1344633518',owner_user_name='tempest-AttachVolumeShelveTestJSON-1344633518-project-member',shelved_at='2023-04-14T13:27:08.558881',shelved_host='user',shelved_image_id='4f68a37c-6f0b-4856-8726-572c25db2b8d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04370605aec40a0a53a080c1e8bf8a8',uuid=f7df0d0b-535b-4a60-a050-ddd6449e3c4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converting VIF {"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ff:1f,bridge_name='br-int',has_traffic_filtering=True,id=3cf56142-3eb9-481f-9e81-b839a2106ab3,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf56142-3e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG os_vif [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ff:1f,bridge_name='br-int',has_traffic_filtering=True,id=3cf56142-3eb9-481f-9e81-b839a2106ab3,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf56142-3e') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cf56142-3e, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3cf56142-3e, col_values=(('external_ids', {'iface-id': '3cf56142-3eb9-481f-9e81-b839a2106ab3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:ff:1f', 'vm-uuid': 'f7df0d0b-535b-4a60-a050-ddd6449e3c4d'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:03 user nova-compute[72019]: INFO os_vif [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ff:1f,bridge_name='br-int',has_traffic_filtering=True,id=3cf56142-3eb9-481f-9e81-b839a2106ab3,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf56142-3e')
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] No VIF found with MAC fa:16:3e:d2:ff:1f, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478928.7467198, 82d3b319-f069-48b6-bb53-32835bc6a2e3 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:29:03 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] VM Stopped (Lifecycle Event)
Apr 14 13:29:03 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a95dea77-9aad-4e26-b960-3dd89eb96976 None None] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:29:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-97446fcf-67a6-4d7e-a93e-511d1f7c0ca0 req-d318dd78-a6f6-4f23-8afb-f2f341c00b73 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received event network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:29:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-97446fcf-67a6-4d7e-a93e-511d1f7c0ca0 req-d318dd78-a6f6-4f23-8afb-f2f341c00b73 service nova] Acquiring lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-97446fcf-67a6-4d7e-a93e-511d1f7c0ca0 req-d318dd78-a6f6-4f23-8afb-f2f341c00b73 service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-97446fcf-67a6-4d7e-a93e-511d1f7c0ca0 req-d318dd78-a6f6-4f23-8afb-f2f341c00b73 service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-97446fcf-67a6-4d7e-a93e-511d1f7c0ca0 req-d318dd78-a6f6-4f23-8afb-f2f341c00b73 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] No waiting events found dispatching network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:29:05 user nova-compute[72019]: WARNING nova.compute.manager [req-97446fcf-67a6-4d7e-a93e-511d1f7c0ca0 req-d318dd78-a6f6-4f23-8afb-f2f341c00b73 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received unexpected event network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 13:29:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:07 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478946.9923744, f7df0d0b-535b-4a60-a050-ddd6449e3c4d => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:29:07 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] VM Resumed (Lifecycle Event)
Apr 14 13:29:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:29:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:29:07 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Instance spawned successfully.
Apr 14 13:29:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:29:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:29:07 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:29:07 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478946.9937606, f7df0d0b-535b-4a60-a050-ddd6449e3c4d => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:29:07 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] VM Started (Lifecycle Event)
Apr 14 13:29:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:29:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:29:07 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:29:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-919e2183-7d0e-4ba6-b34e-2840cf721e84 req-cdd48b8e-af26-4982-b09b-49b3a094adc6 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received event network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:29:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-919e2183-7d0e-4ba6-b34e-2840cf721e84 req-cdd48b8e-af26-4982-b09b-49b3a094adc6 service nova] Acquiring lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-919e2183-7d0e-4ba6-b34e-2840cf721e84 req-cdd48b8e-af26-4982-b09b-49b3a094adc6 service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-919e2183-7d0e-4ba6-b34e-2840cf721e84 req-cdd48b8e-af26-4982-b09b-49b3a094adc6 service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-919e2183-7d0e-4ba6-b34e-2840cf721e84 req-cdd48b8e-af26-4982-b09b-49b3a094adc6 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] No waiting events found dispatching network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:29:07 user nova-compute[72019]: WARNING nova.compute.manager [req-919e2183-7d0e-4ba6-b34e-2840cf721e84 req-cdd48b8e-af26-4982-b09b-49b3a094adc6 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received unexpected event network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 13:29:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:29:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.005s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:21 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:29:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:27 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:29:27 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:29:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:29 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:29:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:29 user nova-compute[72019]: INFO nova.compute.manager [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Terminating instance
Apr 14 13:29:29 user nova-compute[72019]: DEBUG nova.compute.manager [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:29:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-0f597f22-1dbc-4a32-96b7-db1cdd0d6ad4 req-db01ff27-c018-4174-a6b3-c39fcdf6a609 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-vif-unplugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0f597f22-1dbc-4a32-96b7-db1cdd0d6ad4 req-db01ff27-c018-4174-a6b3-c39fcdf6a609 service nova] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0f597f22-1dbc-4a32-96b7-db1cdd0d6ad4 req-db01ff27-c018-4174-a6b3-c39fcdf6a609 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0f597f22-1dbc-4a32-96b7-db1cdd0d6ad4 req-db01ff27-c018-4174-a6b3-c39fcdf6a609 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-0f597f22-1dbc-4a32-96b7-db1cdd0d6ad4 req-db01ff27-c018-4174-a6b3-c39fcdf6a609 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] No waiting events found dispatching network-vif-unplugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-0f597f22-1dbc-4a32-96b7-db1cdd0d6ad4 req-db01ff27-c018-4174-a6b3-c39fcdf6a609 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-vif-unplugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:29:30 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Instance destroyed successfully.
Apr 14 13:29:30 user nova-compute[72019]: DEBUG nova.objects.instance [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'resources' on Instance uuid 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-299687148',display_name='tempest-ServerRescueNegativeTestJSON-server-299687148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-299687148',id=3,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:17:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7c8c8f620334166a141ea65525ba2a0',ramdisk_id='',reservation_id='r-876svson',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1698214771',owner_user_name='tempest-ServerRescueNegativeTestJSON-1698214771-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:19:15Z,user_data=None,user_id='3948b7c643374bcdbeb34f0f2f790c3c',uuid=29dc5faa-e15a-425c-80f8-ddb4f34f43d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converting VIF {"id": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "address": "fa:16:3e:4e:26:54", "network": {"id": "a2caff26-0e2b-4e61-8af1-e13eada766a1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-770502647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7c8c8f620334166a141ea65525ba2a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf15f52ef-e4", "ovs_interfaceid": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:26:54,bridge_name='br-int',has_traffic_filtering=True,id=f15f52ef-e473-4957-8be2-8c3ef6a9aa16,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15f52ef-e4') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG os_vif [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:26:54,bridge_name='br-int',has_traffic_filtering=True,id=f15f52ef-e473-4957-8be2-8c3ef6a9aa16,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15f52ef-e4') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf15f52ef-e4, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:29:30 user nova-compute[72019]: INFO os_vif [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:26:54,bridge_name='br-int',has_traffic_filtering=True,id=f15f52ef-e473-4957-8be2-8c3ef6a9aa16,network=Network(a2caff26-0e2b-4e61-8af1-e13eada766a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf15f52ef-e4')
Apr 14 13:29:30 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Deleting instance files /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4_del
Apr 14 13:29:30 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Deletion of /opt/stack/data/nova/instances/29dc5faa-e15a-425c-80f8-ddb4f34f43d4_del complete
Apr 14 13:29:30 user nova-compute[72019]: INFO nova.compute.manager [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 13:29:30 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:29:30 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:29:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:31 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:29:31 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Took 0.65 seconds to deallocate network for instance.
Apr 14 13:29:31 user nova-compute[72019]: DEBUG nova.compute.manager [req-36c2ef7b-264f-4125-9eb7-8cd400967c5c req-236e59c4-6001-422c-aed9-a6f606125786 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-vif-deleted-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:29:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:31 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:29:31 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:29:31 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:29:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:29:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:29:31 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:29:31 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:29:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:31 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Deleted allocations for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4
Apr 14 13:29:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.061s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:32 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Updating instance_info_cache with network_info: [{"id": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "address": "fa:16:3e:7a:a4:82", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6952bc-e5", "ovs_interfaceid": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:29:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:29:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:29:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-00b6ef70-f1af-4c15-bd86-88f1be3252be req-fd90b993-4f4e-4a1e-bc4c-a33a7cdbbc22 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:29:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-00b6ef70-f1af-4c15-bd86-88f1be3252be req-fd90b993-4f4e-4a1e-bc4c-a33a7cdbbc22 service nova] Acquiring lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-00b6ef70-f1af-4c15-bd86-88f1be3252be req-fd90b993-4f4e-4a1e-bc4c-a33a7cdbbc22 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-00b6ef70-f1af-4c15-bd86-88f1be3252be req-fd90b993-4f4e-4a1e-bc4c-a33a7cdbbc22 service nova] Lock "29dc5faa-e15a-425c-80f8-ddb4f34f43d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:32 user nova-compute[72019]: DEBUG nova.compute.manager [req-00b6ef70-f1af-4c15-bd86-88f1be3252be req-fd90b993-4f4e-4a1e-bc4c-a33a7cdbbc22 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] No waiting events found dispatching network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:29:32 user nova-compute[72019]: WARNING nova.compute.manager [req-00b6ef70-f1af-4c15-bd86-88f1be3252be req-fd90b993-4f4e-4a1e-bc4c-a33a7cdbbc22 service nova] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Received unexpected event network-vif-plugged-f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance with vm_state deleted and task_state None.
Apr 14 13:29:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:29:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:29:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:29:34 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:29:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:29:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:36 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:29:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:29:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:29:39 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:29:39 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7710MB free_disk=26.03348159790039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 626abaa0-3f53-42cc-978e-21f0a80232fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:29:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "167e06f3-4a3d-418d-8aaa-4827c749258d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "167e06f3-4a3d-418d-8aaa-4827c749258d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:29:45 user nova-compute[72019]: INFO nova.compute.claims [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Claim successful on node user
Apr 14 13:29:45 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681478970.5571835, 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:29:45 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] VM Stopped (Lifecycle Event)
Apr 14 13:29:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-498b0eaa-8caf-427f-ac50-ee7867ad46dd None None] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG nova.network.neutron [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:29:45 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:29:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:29:45 user nova-compute[72019]: INFO nova.virt.block_device [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Booting with volume 9056cb37-c575-40f0-9cc7-7cd88b944cd4 at /dev/vda
Apr 14 13:29:45 user nova-compute[72019]: DEBUG nova.policy [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG os_brick.utils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f72d35a-ff44-402a-b5e2-527de2820da3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14c6fee-1f94-423c-bead-a908dc09a5d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0744bb89-98e4-49ca-940a-c754e767c8a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad506568-fada-4593-984c-e5f40a5110fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:29:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:29:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:29:46 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:29:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c35196d-fd30-422c-9d05-8ea2cd6d5764]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:29:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:29:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:29:46 user nova-compute[72019]: DEBUG os_brick.utils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:29:46 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Updating existing volume attachment record: 003ba0b9-fa18-4494-9236-84656c813224 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:29:46 user nova-compute[72019]: DEBUG nova.network.neutron [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Successfully created port: 94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Successfully updated port: 94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "refresh_cache-167e06f3-4a3d-418d-8aaa-4827c749258d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquired lock "refresh_cache-167e06f3-4a3d-418d-8aaa-4827c749258d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-6a9bb7f7-ed24-4a72-b86d-434abf4fee75 req-8a18509a-8201-4469-ab7f-f9323d590f61 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Received event network-changed-94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-6a9bb7f7-ed24-4a72-b86d-434abf4fee75 req-8a18509a-8201-4469-ab7f-f9323d590f61 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Refreshing instance network info cache due to event network-changed-94fca401-a6e6-49b4-bdf9-4419787e733e. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6a9bb7f7-ed24-4a72-b86d-434abf4fee75 req-8a18509a-8201-4469-ab7f-f9323d590f61 service nova] Acquiring lock "refresh_cache-167e06f3-4a3d-418d-8aaa-4827c749258d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Updating instance_info_cache with network_info: [{"id": "94fca401-a6e6-49b4-bdf9-4419787e733e", "address": "fa:16:3e:87:a8:bb", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fca401-a6", "ovs_interfaceid": "94fca401-a6e6-49b4-bdf9-4419787e733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Releasing lock "refresh_cache-167e06f3-4a3d-418d-8aaa-4827c749258d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Instance network_info: |[{"id": "94fca401-a6e6-49b4-bdf9-4419787e733e", "address": "fa:16:3e:87:a8:bb", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fca401-a6", "ovs_interfaceid": "94fca401-a6e6-49b4-bdf9-4419787e733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6a9bb7f7-ed24-4a72-b86d-434abf4fee75 req-8a18509a-8201-4469-ab7f-f9323d590f61 service nova] Acquired lock "refresh_cache-167e06f3-4a3d-418d-8aaa-4827c749258d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:29:47 user nova-compute[72019]: DEBUG nova.network.neutron [req-6a9bb7f7-ed24-4a72-b86d-434abf4fee75 req-8a18509a-8201-4469-ab7f-f9323d590f61 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Refreshing network info cache for port 94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:29:48 user nova-compute[72019]: INFO nova.compute.manager [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] instance snapshotting
Apr 14 13:29:48 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Beginning live snapshot process
Apr 14 13:29:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json -f qcow2 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json -f qcow2 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-6a9bb7f7-ed24-4a72-b86d-434abf4fee75 req-8a18509a-8201-4469-ab7f-f9323d590f61 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Updated VIF entry in instance network info cache for port 94fca401-a6e6-49b4-bdf9-4419787e733e. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:29:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-6a9bb7f7-ed24-4a72-b86d-434abf4fee75 req-8a18509a-8201-4469-ab7f-f9323d590f61 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Updating instance_info_cache with network_info: [{"id": "94fca401-a6e6-49b4-bdf9-4419787e733e", "address": "fa:16:3e:87:a8:bb", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fca401-a6", "ovs_interfaceid": "94fca401-a6e6-49b4-bdf9-4419787e733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:29:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6a9bb7f7-ed24-4a72-b86d-434abf4fee75 req-8a18509a-8201-4469-ab7f-f9323d590f61 service nova] Releasing lock "refresh_cache-167e06f3-4a3d-418d-8aaa-4827c749258d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:29:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json -f qcow2" returned: 0 in 0.148s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp41_4tuly/4b7ae4d47506439d946572d45d4b8ed2.delta 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp41_4tuly/4b7ae4d47506439d946572d45d4b8ed2.delta 1073741824" returned: 0 in 0.053s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:48 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 13:29:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:29:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=72019) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 13:29:49 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp41_4tuly/4b7ae4d47506439d946572d45d4b8ed2.delta /opt/stack/data/nova/instances/snapshots/tmp41_4tuly/4b7ae4d47506439d946572d45d4b8ed2 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp41_4tuly/4b7ae4d47506439d946572d45d4b8ed2.delta /opt/stack/data/nova/instances/snapshots/tmp41_4tuly/4b7ae4d47506439d946572d45d4b8ed2" returned: 0 in 0.370s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:50 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Snapshot extracted, beginning image upload
Apr 14 13:29:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:29:50 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Creating image(s)
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Ensure instance console log exists: /opt/stack/data/nova/instances/167e06f3-4a3d-418d-8aaa-4827c749258d/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Start _get_guest_xml network_info=[{"id": "94fca401-a6e6-49b4-bdf9-4419787e733e", "address": "fa:16:3e:87:a8:bb", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fca401-a6", "ovs_interfaceid": "94fca401-a6e6-49b4-bdf9-4419787e733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '003ba0b9-fa18-4494-9236-84656c813224', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnhPHgQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '167e06f3-4a3d-418d-8aaa-4827c749258d', 'attached_at': '', 'detached_at': '', 'volume_id': '9056cb37-c575-40f0-9cc7-7cd88b944cd4', 'serial': '9056cb37-c575-40f0-9cc7-7cd88b944cd4'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:29:50 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:29:50 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnhPHgQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:29:50 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:29:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:29:50 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:29:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:29:50 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7476e55-0882-434e-ab6d-1199e8f199fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:29:50 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f84fd1-b977-43d4-8c40-431c5a4c4cb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4] added
Apr 14 13:29:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8c5e67-de95-47f5-a220-c2ba008e420c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9dadf0-9f2c-4823-aec6-1965fb7e8541]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:29:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnhPHgQf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnhPHgQf" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c32dd16-a258-4c83-ad0c-5cf5de19145e]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jnhPHgQf'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae36f59b-354a-4573-abe4-4501ed7d4978]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5d5d32-66e3-4806-8f4b-e00e55e1b465]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:29:51 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:29:51 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:29:51 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:29:51 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:29:51 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:29:51 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:29:51 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:29:51 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[259d7e5e-0553-4b7d-8b61-e5f08dcb9a76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260]
Apr 14 13:29:51 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260] successful.
Apr 14 13:29:51 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f196edf7-5a36-43f4-85d9-df1a87ea2c5d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ed11aa-ba11-428a-8f90-0102607c75ca]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:29:51 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:29:51 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:29:51 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:29:51 user nova-compute[72019]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:29:51 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:29:51 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:29:51 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:29:51 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:29:51 user nova-compute[72019]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:29:51 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4aa76b-c44d-4e5c-8ece-6501931fa703]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:29:51 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnhPHgQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26533633233616334', 'path': '/dev/sdd'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533633233616334', 'path': '/dev/sdd'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1166522692',display_name='tempest-TestVolumeBootPattern-server-1166522692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1166522692',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn0p0IUuVWoQy0dGsU9Pfuky6ks2ZRYQtS2s2AMQUPgWS/ZFj3/9xG//6C/vHeESCtbDFovyBlscNk5g1knYdZi4/iSS7XffFRPqq5TMnScynxdTnC9z463yGcQBrDWEQ==',key_name='tempest-TestVolumeBootPattern-212867192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-1mlvjgfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:29:46Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=167e06f3-4a3d-418d-8aaa-4827c749258d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94fca401-a6e6-49b4-bdf9-4419787e733e", "address": "fa:16:3e:87:a8:bb", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fca401-a6", "ovs_interfaceid": "94fca401-a6e6-49b4-bdf9-4419787e733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "94fca401-a6e6-49b4-bdf9-4419787e733e", "address": "fa:16:3e:87:a8:bb", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fca401-a6", "ovs_interfaceid": "94fca401-a6e6-49b4-bdf9-4419787e733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:a8:bb,bridge_name='br-int',has_traffic_filtering=True,id=94fca401-a6e6-49b4-bdf9-4419787e733e,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fca401-a6') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG nova.objects.instance [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lazy-loading 'pci_devices' on Instance uuid 167e06f3-4a3d-418d-8aaa-4827c749258d {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:29:52 user nova-compute[72019]:   <uuid>167e06f3-4a3d-418d-8aaa-4827c749258d</uuid>
Apr 14 13:29:52 user nova-compute[72019]:   <name>instance-00000029</name>
Apr 14 13:29:52 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:29:52 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:29:52 user nova-compute[72019]:   <metadata>
Apr 14 13:29:52 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:29:52 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:29:52 user nova-compute[72019]:       <nova:name>tempest-TestVolumeBootPattern-server-1166522692</nova:name>
Apr 14 13:29:52 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:29:50</nova:creationTime>
Apr 14 13:29:52 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:29:52 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:29:52 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:29:52 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:29:52 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:29:52 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:29:52 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:29:52 user nova-compute[72019]:       <nova:owner>
Apr 14 13:29:52 user nova-compute[72019]:         <nova:user uuid="bb40413bd0c3490d97b997f69c930f72">tempest-TestVolumeBootPattern-1645546988-project-member</nova:user>
Apr 14 13:29:52 user nova-compute[72019]:         <nova:project uuid="818de6fa330c4c87a3b6228345d9f13a">tempest-TestVolumeBootPattern-1645546988</nova:project>
Apr 14 13:29:52 user nova-compute[72019]:       </nova:owner>
Apr 14 13:29:52 user nova-compute[72019]:       <nova:ports>
Apr 14 13:29:52 user nova-compute[72019]:         <nova:port uuid="94fca401-a6e6-49b4-bdf9-4419787e733e">
Apr 14 13:29:52 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 13:29:52 user nova-compute[72019]:         </nova:port>
Apr 14 13:29:52 user nova-compute[72019]:       </nova:ports>
Apr 14 13:29:52 user nova-compute[72019]:     </nova:instance>
Apr 14 13:29:52 user nova-compute[72019]:   </metadata>
Apr 14 13:29:52 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:29:52 user nova-compute[72019]:     <system>
Apr 14 13:29:52 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:29:52 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:29:52 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:29:52 user nova-compute[72019]:       <entry name="serial">167e06f3-4a3d-418d-8aaa-4827c749258d</entry>
Apr 14 13:29:52 user nova-compute[72019]:       <entry name="uuid">167e06f3-4a3d-418d-8aaa-4827c749258d</entry>
Apr 14 13:29:52 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:29:52 user nova-compute[72019]:     </system>
Apr 14 13:29:52 user nova-compute[72019]:   </sysinfo>
Apr 14 13:29:52 user nova-compute[72019]:   <os>
Apr 14 13:29:52 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:29:52 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:29:52 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:29:52 user nova-compute[72019]:   </os>
Apr 14 13:29:52 user nova-compute[72019]:   <features>
Apr 14 13:29:52 user nova-compute[72019]:     <acpi/>
Apr 14 13:29:52 user nova-compute[72019]:     <apic/>
Apr 14 13:29:52 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:29:52 user nova-compute[72019]:   </features>
Apr 14 13:29:52 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:29:52 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:29:52 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:29:52 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:29:52 user nova-compute[72019]:   </clock>
Apr 14 13:29:52 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:29:52 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:29:52 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:29:52 user nova-compute[72019]:   </cpu>
Apr 14 13:29:52 user nova-compute[72019]:   <devices>
Apr 14 13:29:52 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:29:52 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:29:52 user nova-compute[72019]:       <source dev="/dev/sdd"/>
Apr 14 13:29:52 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:29:52 user nova-compute[72019]:       <serial>9056cb37-c575-40f0-9cc7-7cd88b944cd4</serial>
Apr 14 13:29:52 user nova-compute[72019]:     </disk>
Apr 14 13:29:52 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:29:52 user nova-compute[72019]:       <mac address="fa:16:3e:87:a8:bb"/>
Apr 14 13:29:52 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:29:52 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:29:52 user nova-compute[72019]:       <target dev="tap94fca401-a6"/>
Apr 14 13:29:52 user nova-compute[72019]:     </interface>
Apr 14 13:29:52 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:29:52 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/167e06f3-4a3d-418d-8aaa-4827c749258d/console.log" append="off"/>
Apr 14 13:29:52 user nova-compute[72019]:     </serial>
Apr 14 13:29:52 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:29:52 user nova-compute[72019]:     <video>
Apr 14 13:29:52 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:29:52 user nova-compute[72019]:     </video>
Apr 14 13:29:52 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:29:52 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:29:52 user nova-compute[72019]:     </rng>
Apr 14 13:29:52 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:29:52 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:29:52 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:29:52 user nova-compute[72019]:     </memballoon>
Apr 14 13:29:52 user nova-compute[72019]:   </devices>
Apr 14 13:29:52 user nova-compute[72019]: </domain>
Apr 14 13:29:52 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1166522692',display_name='tempest-TestVolumeBootPattern-server-1166522692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1166522692',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn0p0IUuVWoQy0dGsU9Pfuky6ks2ZRYQtS2s2AMQUPgWS/ZFj3/9xG//6C/vHeESCtbDFovyBlscNk5g1knYdZi4/iSS7XffFRPqq5TMnScynxdTnC9z463yGcQBrDWEQ==',key_name='tempest-TestVolumeBootPattern-212867192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-1mlvjgfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:29:46Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=167e06f3-4a3d-418d-8aaa-4827c749258d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94fca401-a6e6-49b4-bdf9-4419787e733e", "address": "fa:16:3e:87:a8:bb", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fca401-a6", "ovs_interfaceid": "94fca401-a6e6-49b4-bdf9-4419787e733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "94fca401-a6e6-49b4-bdf9-4419787e733e", "address": "fa:16:3e:87:a8:bb", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fca401-a6", "ovs_interfaceid": "94fca401-a6e6-49b4-bdf9-4419787e733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:a8:bb,bridge_name='br-int',has_traffic_filtering=True,id=94fca401-a6e6-49b4-bdf9-4419787e733e,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fca401-a6') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG os_vif [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:a8:bb,bridge_name='br-int',has_traffic_filtering=True,id=94fca401-a6e6-49b4-bdf9-4419787e733e,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fca401-a6') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94fca401-a6, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94fca401-a6, col_values=(('external_ids', {'iface-id': '94fca401-a6e6-49b4-bdf9-4419787e733e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:a8:bb', 'vm-uuid': '167e06f3-4a3d-418d-8aaa-4827c749258d'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:52 user nova-compute[72019]: INFO os_vif [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:a8:bb,bridge_name='br-int',has_traffic_filtering=True,id=94fca401-a6e6-49b4-bdf9-4419787e733e,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fca401-a6')
Apr 14 13:29:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:29:52 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] No VIF found with MAC fa:16:3e:87:a8:bb, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:29:52 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Snapshot image upload complete
Apr 14 13:29:52 user nova-compute[72019]: INFO nova.compute.manager [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Took 4.75 seconds to snapshot the instance on the hypervisor.
Apr 14 13:29:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-4c7b517c-48d4-4a03-8972-d618e595cdbb req-71a70338-97c7-4f01-ab0d-0f6eac1638d9 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Received event network-vif-plugged-94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:29:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4c7b517c-48d4-4a03-8972-d618e595cdbb req-71a70338-97c7-4f01-ab0d-0f6eac1638d9 service nova] Acquiring lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4c7b517c-48d4-4a03-8972-d618e595cdbb req-71a70338-97c7-4f01-ab0d-0f6eac1638d9 service nova] Lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4c7b517c-48d4-4a03-8972-d618e595cdbb req-71a70338-97c7-4f01-ab0d-0f6eac1638d9 service nova] Lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-4c7b517c-48d4-4a03-8972-d618e595cdbb req-71a70338-97c7-4f01-ab0d-0f6eac1638d9 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] No waiting events found dispatching network-vif-plugged-94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:29:53 user nova-compute[72019]: WARNING nova.compute.manager [req-4c7b517c-48d4-4a03-8972-d618e595cdbb req-71a70338-97c7-4f01-ab0d-0f6eac1638d9 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Received unexpected event network-vif-plugged-94fca401-a6e6-49b4-bdf9-4419787e733e for instance with vm_state building and task_state spawning.
Apr 14 13:29:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478995.906335, 167e06f3-4a3d-418d-8aaa-4827c749258d => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:29:55 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] VM Resumed (Lifecycle Event)
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.compute.manager [req-b2db9ebd-765b-4ebb-9936-2e07ad5132c8 req-51592656-eee0-42b8-b30f-4c9b4cc2e504 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Received event network-vif-plugged-94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b2db9ebd-765b-4ebb-9936-2e07ad5132c8 req-51592656-eee0-42b8-b30f-4c9b4cc2e504 service nova] Acquiring lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b2db9ebd-765b-4ebb-9936-2e07ad5132c8 req-51592656-eee0-42b8-b30f-4c9b4cc2e504 service nova] Lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b2db9ebd-765b-4ebb-9936-2e07ad5132c8 req-51592656-eee0-42b8-b30f-4c9b4cc2e504 service nova] Lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.compute.manager [req-b2db9ebd-765b-4ebb-9936-2e07ad5132c8 req-51592656-eee0-42b8-b30f-4c9b4cc2e504 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] No waiting events found dispatching network-vif-plugged-94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:29:55 user nova-compute[72019]: WARNING nova.compute.manager [req-b2db9ebd-765b-4ebb-9936-2e07ad5132c8 req-51592656-eee0-42b8-b30f-4c9b4cc2e504 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Received unexpected event network-vif-plugged-94fca401-a6e6-49b4-bdf9-4419787e733e for instance with vm_state building and task_state spawning.
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:29:55 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Instance spawned successfully.
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:29:55 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681478995.9078739, 167e06f3-4a3d-418d-8aaa-4827c749258d => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:29:55 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] VM Started (Lifecycle Event)
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:29:55 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:29:55 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:29:56 user nova-compute[72019]: INFO nova.compute.manager [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Took 5.19 seconds to spawn the instance on the hypervisor.
Apr 14 13:29:56 user nova-compute[72019]: DEBUG nova.compute.manager [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:29:56 user nova-compute[72019]: INFO nova.compute.manager [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Took 10.88 seconds to build instance.
Apr 14 13:29:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "167e06f3-4a3d-418d-8aaa-4827c749258d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.990s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:29:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "3c0f7d33-ba0c-4111-857d-319c5788106f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:29:58 user nova-compute[72019]: INFO nova.compute.claims [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Claim successful on node user
Apr 14 13:29:58 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:29:58 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:29:58 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG nova.policy [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd53a298063a346ec9b41110051e689c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6e06c2dbf479697403fee2b1b72e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:29:58 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Creating image(s)
Apr 14 13:29:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "/opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "/opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "55cba9267df7218331c8650644894eb80965e559" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:29:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "55cba9267df7218331c8650644894eb80965e559" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:29:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559.part --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:59 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Successfully created port: e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:29:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559.part --force-share --output=json" returned: 0 in 0.150s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:59 user nova-compute[72019]: DEBUG nova.virt.images [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] fdaeaeaf-d612-4b58-80b5-8cf70c8002c5 was qcow2, converting to raw {{(pid=72019) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 13:29:59 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:29:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559.part /opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559.converted {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:29:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559.part /opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559.converted" returned: 0 in 0.347s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:29:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559.converted --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559.converted --force-share --output=json" returned: 0 in 0.162s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "55cba9267df7218331c8650644894eb80965e559" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.360s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559 --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559 --force-share --output=json" returned: 0 in 0.151s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "55cba9267df7218331c8650644894eb80965e559" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "55cba9267df7218331c8650644894eb80965e559" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559 --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Successfully updated port: e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-f59c795e-1e9b-48ff-8cbb-f025b61c17b4 req-0de5d9b8-cc7e-4d77-a24c-f477b4298c4f service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Received event network-changed-e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-f59c795e-1e9b-48ff-8cbb-f025b61c17b4 req-0de5d9b8-cc7e-4d77-a24c-f477b4298c4f service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Refreshing instance network info cache due to event network-changed-e5381c33-8ca2-44a1-92a9-adda19cd90a5. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f59c795e-1e9b-48ff-8cbb-f025b61c17b4 req-0de5d9b8-cc7e-4d77-a24c-f477b4298c4f service nova] Acquiring lock "refresh_cache-3c0f7d33-ba0c-4111-857d-319c5788106f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f59c795e-1e9b-48ff-8cbb-f025b61c17b4 req-0de5d9b8-cc7e-4d77-a24c-f477b4298c4f service nova] Acquired lock "refresh_cache-3c0f7d33-ba0c-4111-857d-319c5788106f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG nova.network.neutron [req-f59c795e-1e9b-48ff-8cbb-f025b61c17b4 req-0de5d9b8-cc7e-4d77-a24c-f477b4298c4f service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Refreshing network info cache for port e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "refresh_cache-3c0f7d33-ba0c-4111-857d-319c5788106f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559 --force-share --output=json" returned: 0 in 0.184s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559,backing_fmt=raw /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559,backing_fmt=raw /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk 1073741824" returned: 0 in 0.050s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "55cba9267df7218331c8650644894eb80965e559" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559 --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG nova.network.neutron [req-f59c795e-1e9b-48ff-8cbb-f025b61c17b4 req-0de5d9b8-cc7e-4d77-a24c-f477b4298c4f service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55cba9267df7218331c8650644894eb80965e559 --force-share --output=json" returned: 0 in 0.154s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lazy-loading 'migration_context' on Instance uuid 3c0f7d33-ba0c-4111-857d-319c5788106f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Ensure instance console log exists: /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:00 user nova-compute[72019]: DEBUG nova.network.neutron [req-f59c795e-1e9b-48ff-8cbb-f025b61c17b4 req-0de5d9b8-cc7e-4d77-a24c-f477b4298c4f service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f59c795e-1e9b-48ff-8cbb-f025b61c17b4 req-0de5d9b8-cc7e-4d77-a24c-f477b4298c4f service nova] Releasing lock "refresh_cache-3c0f7d33-ba0c-4111-857d-319c5788106f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquired lock "refresh_cache-3c0f7d33-ba0c-4111-857d-319c5788106f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Updating instance_info_cache with network_info: [{"id": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "address": "fa:16:3e:e9:76:a4", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5381c33-8c", "ovs_interfaceid": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Releasing lock "refresh_cache-3c0f7d33-ba0c-4111-857d-319c5788106f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Instance network_info: |[{"id": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "address": "fa:16:3e:e9:76:a4", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5381c33-8c", "ovs_interfaceid": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Start _get_guest_xml network_info=[{"id": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "address": "fa:16:3e:e9:76:a4", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5381c33-8c", "ovs_interfaceid": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='672002cdbdfd81a313f93a72b81b641f',container_format='bare',created_at=2023-04-14T13:29:48Z,direct_url=<?>,disk_format='qcow2',id=fdaeaeaf-d612-4b58-80b5-8cf70c8002c5,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-74539980',owner='fdd6e06c2dbf479697403fee2b1b72e2',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T13:29:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': 'fdaeaeaf-d612-4b58-80b5-8cf70c8002c5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:30:01 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:30:01 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='672002cdbdfd81a313f93a72b81b641f',container_format='bare',created_at=2023-04-14T13:29:48Z,direct_url=<?>,disk_format='qcow2',id=fdaeaeaf-d612-4b58-80b5-8cf70c8002c5,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-74539980',owner='fdd6e06c2dbf479697403fee2b1b72e2',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T13:29:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-846458075',display_name='tempest-TestStampPattern-server-846458075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-846458075',id=42,image_ref='fdaeaeaf-d612-4b58-80b5-8cf70c8002c5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIm4aARBA4lAX/hfwMD4oBZFv2cTXlcgSngjcTEDIv9RAHTvjbNkAIIQYYwrK0JxNUWLzReMonMtMkMBWIgzI882038PhtWRli7iqrN9dwPmOnFtL9wStfKPVLf4sjHM0w==',key_name='tempest-TestStampPattern-924006334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdd6e06c2dbf479697403fee2b1b72e2',ramdisk_id='',reservation_id='r-1mmr2d69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='31781f5a-460a-41e3-bdcf-9cb20f050ba3',image_min_disk='1',image_min_ram='0',image_owner_id='fdd6e06c2dbf479697403fee2b1b72e2',image_owner_project_name='tempest-TestStampPattern-1896841208',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1896841208-project-member',image_user_id='d53a298063a346ec9b41110051e689c8',network_allocated='True',owner_project_name='tempest-TestStampPattern-1896841208',owner_user_name='tempest-TestStampPattern-1896841208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:29:59Z,user_data=None,user_id='d53a298063a346ec9b41110051e689c8',uuid=3c0f7d33-ba0c-4111-857d-319c5788106f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "address": "fa:16:3e:e9:76:a4", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5381c33-8c", "ovs_interfaceid": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Converting VIF {"id": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "address": "fa:16:3e:e9:76:a4", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5381c33-8c", "ovs_interfaceid": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:76:a4,bridge_name='br-int',has_traffic_filtering=True,id=e5381c33-8ca2-44a1-92a9-adda19cd90a5,network=Network(09bf32cb-4684-4c95-a44c-6924d228b6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5381c33-8c') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c0f7d33-ba0c-4111-857d-319c5788106f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:30:01 user nova-compute[72019]:   <uuid>3c0f7d33-ba0c-4111-857d-319c5788106f</uuid>
Apr 14 13:30:01 user nova-compute[72019]:   <name>instance-0000002a</name>
Apr 14 13:30:01 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:30:01 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:30:01 user nova-compute[72019]:   <metadata>
Apr 14 13:30:01 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:30:01 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:30:01 user nova-compute[72019]:       <nova:name>tempest-TestStampPattern-server-846458075</nova:name>
Apr 14 13:30:01 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:30:01</nova:creationTime>
Apr 14 13:30:01 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:30:01 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:30:01 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:30:01 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:30:01 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:30:01 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:30:01 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:30:01 user nova-compute[72019]:       <nova:owner>
Apr 14 13:30:01 user nova-compute[72019]:         <nova:user uuid="d53a298063a346ec9b41110051e689c8">tempest-TestStampPattern-1896841208-project-member</nova:user>
Apr 14 13:30:01 user nova-compute[72019]:         <nova:project uuid="fdd6e06c2dbf479697403fee2b1b72e2">tempest-TestStampPattern-1896841208</nova:project>
Apr 14 13:30:01 user nova-compute[72019]:       </nova:owner>
Apr 14 13:30:01 user nova-compute[72019]:       <nova:root type="image" uuid="fdaeaeaf-d612-4b58-80b5-8cf70c8002c5"/>
Apr 14 13:30:01 user nova-compute[72019]:       <nova:ports>
Apr 14 13:30:01 user nova-compute[72019]:         <nova:port uuid="e5381c33-8ca2-44a1-92a9-adda19cd90a5">
Apr 14 13:30:01 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 13:30:01 user nova-compute[72019]:         </nova:port>
Apr 14 13:30:01 user nova-compute[72019]:       </nova:ports>
Apr 14 13:30:01 user nova-compute[72019]:     </nova:instance>
Apr 14 13:30:01 user nova-compute[72019]:   </metadata>
Apr 14 13:30:01 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:30:01 user nova-compute[72019]:     <system>
Apr 14 13:30:01 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:30:01 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:30:01 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:30:01 user nova-compute[72019]:       <entry name="serial">3c0f7d33-ba0c-4111-857d-319c5788106f</entry>
Apr 14 13:30:01 user nova-compute[72019]:       <entry name="uuid">3c0f7d33-ba0c-4111-857d-319c5788106f</entry>
Apr 14 13:30:01 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:30:01 user nova-compute[72019]:     </system>
Apr 14 13:30:01 user nova-compute[72019]:   </sysinfo>
Apr 14 13:30:01 user nova-compute[72019]:   <os>
Apr 14 13:30:01 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:30:01 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:30:01 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:30:01 user nova-compute[72019]:   </os>
Apr 14 13:30:01 user nova-compute[72019]:   <features>
Apr 14 13:30:01 user nova-compute[72019]:     <acpi/>
Apr 14 13:30:01 user nova-compute[72019]:     <apic/>
Apr 14 13:30:01 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:30:01 user nova-compute[72019]:   </features>
Apr 14 13:30:01 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:30:01 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:30:01 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:30:01 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:30:01 user nova-compute[72019]:   </clock>
Apr 14 13:30:01 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:30:01 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:30:01 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:30:01 user nova-compute[72019]:   </cpu>
Apr 14 13:30:01 user nova-compute[72019]:   <devices>
Apr 14 13:30:01 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:30:01 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:30:01 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk"/>
Apr 14 13:30:01 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:30:01 user nova-compute[72019]:     </disk>
Apr 14 13:30:01 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:30:01 user nova-compute[72019]:       <mac address="fa:16:3e:e9:76:a4"/>
Apr 14 13:30:01 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:30:01 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:30:01 user nova-compute[72019]:       <target dev="tape5381c33-8c"/>
Apr 14 13:30:01 user nova-compute[72019]:     </interface>
Apr 14 13:30:01 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:30:01 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/console.log" append="off"/>
Apr 14 13:30:01 user nova-compute[72019]:     </serial>
Apr 14 13:30:01 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:30:01 user nova-compute[72019]:     <video>
Apr 14 13:30:01 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:30:01 user nova-compute[72019]:     </video>
Apr 14 13:30:01 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:30:01 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:30:01 user nova-compute[72019]:     </rng>
Apr 14 13:30:01 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:30:01 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:30:01 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:30:01 user nova-compute[72019]:     </memballoon>
Apr 14 13:30:01 user nova-compute[72019]:   </devices>
Apr 14 13:30:01 user nova-compute[72019]: </domain>
Apr 14 13:30:01 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-846458075',display_name='tempest-TestStampPattern-server-846458075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-846458075',id=42,image_ref='fdaeaeaf-d612-4b58-80b5-8cf70c8002c5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIm4aARBA4lAX/hfwMD4oBZFv2cTXlcgSngjcTEDIv9RAHTvjbNkAIIQYYwrK0JxNUWLzReMonMtMkMBWIgzI882038PhtWRli7iqrN9dwPmOnFtL9wStfKPVLf4sjHM0w==',key_name='tempest-TestStampPattern-924006334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdd6e06c2dbf479697403fee2b1b72e2',ramdisk_id='',reservation_id='r-1mmr2d69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='31781f5a-460a-41e3-bdcf-9cb20f050ba3',image_min_disk='1',image_min_ram='0',image_owner_id='fdd6e06c2dbf479697403fee2b1b72e2',image_owner_project_name='tempest-TestStampPattern-1896841208',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1896841208-project-member',image_user_id='d53a298063a346ec9b41110051e689c8',network_allocated='True',owner_project_name='tempest-TestStampPattern-1896841208',owner_user_name='tempest-TestStampPattern-1896841208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:29:59Z,user_data=None,user_id='d53a298063a346ec9b41110051e689c8',uuid=3c0f7d33-ba0c-4111-857d-319c5788106f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "address": "fa:16:3e:e9:76:a4", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5381c33-8c", "ovs_interfaceid": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Converting VIF {"id": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "address": "fa:16:3e:e9:76:a4", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5381c33-8c", "ovs_interfaceid": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:76:a4,bridge_name='br-int',has_traffic_filtering=True,id=e5381c33-8ca2-44a1-92a9-adda19cd90a5,network=Network(09bf32cb-4684-4c95-a44c-6924d228b6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5381c33-8c') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG os_vif [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:76:a4,bridge_name='br-int',has_traffic_filtering=True,id=e5381c33-8ca2-44a1-92a9-adda19cd90a5,network=Network(09bf32cb-4684-4c95-a44c-6924d228b6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5381c33-8c') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5381c33-8c, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape5381c33-8c, col_values=(('external_ids', {'iface-id': 'e5381c33-8ca2-44a1-92a9-adda19cd90a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:76:a4', 'vm-uuid': '3c0f7d33-ba0c-4111-857d-319c5788106f'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:01 user nova-compute[72019]: INFO os_vif [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:76:a4,bridge_name='br-int',has_traffic_filtering=True,id=e5381c33-8ca2-44a1-92a9-adda19cd90a5,network=Network(09bf32cb-4684-4c95-a44c-6924d228b6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5381c33-8c')
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:30:01 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] No VIF found with MAC fa:16:3e:e9:76:a4, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:30:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:03 user nova-compute[72019]: DEBUG nova.compute.manager [req-8af6d3f9-b59f-404e-8a3d-a1b937a59ea7 req-ee9a702a-d20c-4d8b-8edf-53d77afe2d09 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Received event network-vif-plugged-e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8af6d3f9-b59f-404e-8a3d-a1b937a59ea7 req-ee9a702a-d20c-4d8b-8edf-53d77afe2d09 service nova] Acquiring lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8af6d3f9-b59f-404e-8a3d-a1b937a59ea7 req-ee9a702a-d20c-4d8b-8edf-53d77afe2d09 service nova] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8af6d3f9-b59f-404e-8a3d-a1b937a59ea7 req-ee9a702a-d20c-4d8b-8edf-53d77afe2d09 service nova] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:03 user nova-compute[72019]: DEBUG nova.compute.manager [req-8af6d3f9-b59f-404e-8a3d-a1b937a59ea7 req-ee9a702a-d20c-4d8b-8edf-53d77afe2d09 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] No waiting events found dispatching network-vif-plugged-e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:03 user nova-compute[72019]: WARNING nova.compute.manager [req-8af6d3f9-b59f-404e-8a3d-a1b937a59ea7 req-ee9a702a-d20c-4d8b-8edf-53d77afe2d09 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Received unexpected event network-vif-plugged-e5381c33-8ca2-44a1-92a9-adda19cd90a5 for instance with vm_state building and task_state spawning.
Apr 14 13:30:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:04 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479004.9392195, 3c0f7d33-ba0c-4111-857d-319c5788106f => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:30:04 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] VM Resumed (Lifecycle Event)
Apr 14 13:30:04 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:30:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:30:04 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Instance spawned successfully.
Apr 14 13:30:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:30:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:30:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:30:04 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:30:04 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:30:04 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:30:04 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479004.9423075, 3c0f7d33-ba0c-4111-857d-319c5788106f => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:30:04 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] VM Started (Lifecycle Event)
Apr 14 13:30:05 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:30:05 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:30:05 user nova-compute[72019]: INFO nova.compute.manager [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Took 6.24 seconds to spawn the instance on the hypervisor.
Apr 14 13:30:05 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:30:05 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:30:05 user nova-compute[72019]: INFO nova.compute.manager [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Took 7.07 seconds to build instance.
Apr 14 13:30:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.166s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-1d0fcc2b-213b-4fed-b34d-f1702b0a4ef4 req-90e0ce5a-2c1c-45a8-aca2-245c40a3de98 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Received event network-vif-plugged-e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1d0fcc2b-213b-4fed-b34d-f1702b0a4ef4 req-90e0ce5a-2c1c-45a8-aca2-245c40a3de98 service nova] Acquiring lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1d0fcc2b-213b-4fed-b34d-f1702b0a4ef4 req-90e0ce5a-2c1c-45a8-aca2-245c40a3de98 service nova] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-1d0fcc2b-213b-4fed-b34d-f1702b0a4ef4 req-90e0ce5a-2c1c-45a8-aca2-245c40a3de98 service nova] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-1d0fcc2b-213b-4fed-b34d-f1702b0a4ef4 req-90e0ce5a-2c1c-45a8-aca2-245c40a3de98 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] No waiting events found dispatching network-vif-plugged-e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:05 user nova-compute[72019]: WARNING nova.compute.manager [req-1d0fcc2b-213b-4fed-b34d-f1702b0a4ef4 req-90e0ce5a-2c1c-45a8-aca2-245c40a3de98 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Received unexpected event network-vif-plugged-e5381c33-8ca2-44a1-92a9-adda19cd90a5 for instance with vm_state active and task_state None.
Apr 14 13:30:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:11 user nova-compute[72019]: INFO nova.compute.manager [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Rescuing
Apr 14 13:30:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "refresh_cache-626abaa0-3f53-42cc-978e-21f0a80232fa" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:30:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquired lock "refresh_cache-626abaa0-3f53-42cc-978e-21f0a80232fa" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:30:11 user nova-compute[72019]: DEBUG nova.network.neutron [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:30:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:11 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'flavor' on Instance uuid 9970f98b-ade9-4d08-a88d-b11a222adcf9 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:30:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:11 user nova-compute[72019]: INFO nova.compute.manager [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Attaching volume 3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d to /dev/vdb
Apr 14 13:30:11 user nova-compute[72019]: DEBUG nova.network.neutron [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Updating instance_info_cache with network_info: [{"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:30:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Releasing lock "refresh_cache-626abaa0-3f53-42cc-978e-21f0a80232fa" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG os_brick.utils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee73ad5-8cf5-4278-8ef5-c36d1d001bd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[384d1a36-c861-4057-980d-9c3c42350363]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[51aeeeb1-75a9-49fa-a3a3-36cabfed0bb4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bb4d0f-6e9c-4b0c-851d-affdf8bdc0f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:30:12 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f72ef8-3ff3-4059-8945-42ae5bb1bd29]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG os_brick.utils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Updating existing volume attachment record: f271c7d7-090b-445f-bdfa-759437d83f4f {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-f092a2ca-7d48-46d0-8748-d11d6f4185f2 req-50624bc0-7e4f-412f-a077-a8caada6a381 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-vif-unplugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f092a2ca-7d48-46d0-8748-d11d6f4185f2 req-50624bc0-7e4f-412f-a077-a8caada6a381 service nova] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f092a2ca-7d48-46d0-8748-d11d6f4185f2 req-50624bc0-7e4f-412f-a077-a8caada6a381 service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f092a2ca-7d48-46d0-8748-d11d6f4185f2 req-50624bc0-7e4f-412f-a077-a8caada6a381 service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-f092a2ca-7d48-46d0-8748-d11d6f4185f2 req-50624bc0-7e4f-412f-a077-a8caada6a381 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] No waiting events found dispatching network-vif-unplugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:12 user nova-compute[72019]: WARNING nova.compute.manager [req-f092a2ca-7d48-46d0-8748-d11d6f4185f2 req-50624bc0-7e4f-412f-a077-a8caada6a381 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received unexpected event network-vif-unplugged-7d5d9e2b-b502-494a-ac52-70930eda92ac for instance with vm_state active and task_state rescuing.
Apr 14 13:30:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:12 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Instance destroyed successfully.
Apr 14 13:30:12 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Attempting a stable device rescue
Apr 14 13:30:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72019) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Instance directory exists: not creating {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 13:30:12 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Creating image(s)
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "/opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "/opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "/opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'trusted_certs' on Instance uuid 626abaa0-3f53-42cc-978e-21f0a80232fa {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "0ab4cfaa54c92a397e7ce0f874731c8b0223df17" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "0ab4cfaa54c92a397e7ce0f874731c8b0223df17" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:13 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab4cfaa54c92a397e7ce0f874731c8b0223df17.part --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab4cfaa54c92a397e7ce0f874731c8b0223df17.part --force-share --output=json" returned: 0 in 0.154s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.images [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 990e1d18-2cad-416d-bea0-e76f85eb68ca was qcow2, converting to raw {{(pid=72019) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.privsep.utils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72019) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ab4cfaa54c92a397e7ce0f874731c8b0223df17.part /opt/stack/data/nova/instances/_base/0ab4cfaa54c92a397e7ce0f874731c8b0223df17.converted {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ab4cfaa54c92a397e7ce0f874731c8b0223df17.part /opt/stack/data/nova/instances/_base/0ab4cfaa54c92a397e7ce0f874731c8b0223df17.converted" returned: 0 in 0.394s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab4cfaa54c92a397e7ce0f874731c8b0223df17.converted --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] No waiting events found dispatching network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:14 user nova-compute[72019]: WARNING nova.compute.manager [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received unexpected event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac for instance with vm_state active and task_state rescuing.
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-changed-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Refreshing instance network info cache due to event network-changed-2a3ecee8-e3fc-433e-81d5-f0c9decfd248. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] Acquiring lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] Acquired lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.network.neutron [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Refreshing network info cache for port 2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab4cfaa54c92a397e7ce0f874731c8b0223df17.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "0ab4cfaa54c92a397e7ce0f874731c8b0223df17" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.735s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "0ab4cfaa54c92a397e7ce0f874731c8b0223df17" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "0ab4cfaa54c92a397e7ce0f874731c8b0223df17" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab4cfaa54c92a397e7ce0f874731c8b0223df17 --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:14 user nova-compute[72019]: INFO nova.compute.manager [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Shelve offloading
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab4cfaa54c92a397e7ce0f874731c8b0223df17 --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ab4cfaa54c92a397e7ce0f874731c8b0223df17,backing_fmt=raw /opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/disk.rescue {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ab4cfaa54c92a397e7ce0f874731c8b0223df17,backing_fmt=raw /opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/disk.rescue" returned: 0 in 0.061s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "0ab4cfaa54c92a397e7ce0f874731c8b0223df17" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'migration_context' on Instance uuid 626abaa0-3f53-42cc-978e-21f0a80232fa {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Start _get_guest_xml network_info=[{"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "vif_mac": "fa:16:3e:15:c3:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '990e1d18-2cad-416d-bea0-e76f85eb68ca', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '597f8f8d-f3ff-45ab-94b5-edc0311bd571', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcFLujaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '626abaa0-3f53-42cc-978e-21f0a80232fa', 'attached_at': '', 'detached_at': '', 'volume_id': '4e65ce2e-31ed-49fb-81e0-dd8f8e767272', 'serial': '4e65ce2e-31ed-49fb-81e0-dd8f8e767272'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'resources' on Instance uuid 626abaa0-3f53-42cc-978e-21f0a80232fa {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'numa_topology' on Instance uuid 626abaa0-3f53-42cc-978e-21f0a80232fa {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:14 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:30:14 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'vcpu_model' on Instance uuid 626abaa0-3f53-42cc-978e-21f0a80232fa {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:30:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcFLujaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:30:15 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:30:15 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:30:15 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8ede64-36b6-4bfc-9915-937e7cf6ce8a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JcFLujaY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 13:30:15 user nova-compute[72019]: node.name = iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272
Apr 14 13:30:15 user nova-compute[72019]: node.tpgt = -1
Apr 14 13:30:15 user nova-compute[72019]: node.startup = automatic
Apr 14 13:30:15 user nova-compute[72019]: node.leading_login = No
Apr 14 13:30:15 user nova-compute[72019]: iface.iscsi_ifacename = default
Apr 14 13:30:15 user nova-compute[72019]: iface.net_ifacename = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.ipaddress = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.prefix_len = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.hwaddress = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.transport_name = tcp
Apr 14 13:30:15 user nova-compute[72019]: iface.initiatorname = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.state = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.vlan_id = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.vlan_priority = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.vlan_state = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.iface_num = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.mtu = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.port = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.bootproto = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.subnet_mask = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.gateway = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.dhcp_alt_client_id = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.dhcp_dns = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.dhcp_learn_iqn = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.dhcp_vendor_id_state = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.dhcp_vendor_id = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.dhcp_slp_da = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.fragmentation = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.gratuitous_arp = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.incoming_forwarding = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.tos_state = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.tos = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.ttl = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.delayed_ack = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.tcp_nagle = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.tcp_wsf_state = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.tcp_wsf = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.tcp_timer_scale = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.tcp_timestamp = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.redirect = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.def_task_mgmt_timeout = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.header_digest = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.data_digest = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.immediate_data = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.initial_r2t = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.data_seq_inorder = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.data_pdu_inorder = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.erl = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.max_receive_data_len = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.first_burst_len = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.max_outstanding_r2t = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.max_burst_len = 0
Apr 14 13:30:15 user nova-compute[72019]: iface.chap_auth = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.bidi_chap = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.strict_login_compliance = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.discovery_auth = <empty>
Apr 14 13:30:15 user nova-compute[72019]: iface.discovery_logout = <empty>
Apr 14 13:30:15 user nova-compute[72019]: node.discovery_address = <empty>
Apr 14 13:30:15 user nova-compute[72019]: node.discovery_port = 0
Apr 14 13:30:15 user nova-compute[72019]: node.discovery_type = static
Apr 14 13:30:15 user nova-compute[72019]: node.session.initial_cmdsn = 0
Apr 14 13:30:15 user nova-compute[72019]: node.session.initial_login_retry_max = 8
Apr 14 13:30:15 user nova-compute[72019]: node.session.xmit_thread_priority = -20
Apr 14 13:30:15 user nova-compute[72019]: node.session.cmds_max = 128
Apr 14 13:30:15 user nova-compute[72019]: node.session.queue_depth = 32
Apr 14 13:30:15 user nova-compute[72019]: node.session.nr_sessions = 1
Apr 14 13:30:15 user nova-compute[72019]: node.session.auth.authmethod = CHAP
Apr 14 13:30:15 user nova-compute[72019]: node.session.auth.username = JcFLujaY
Apr 14 13:30:15 user nova-compute[72019]: node.session.auth.password = ***
Apr 14 13:30:15 user nova-compute[72019]: node.session.auth.username_in = <empty>
Apr 14 13:30:15 user nova-compute[72019]: node.session.auth.password_in = <empty>
Apr 14 13:30:15 user nova-compute[72019]: node.session.auth.chap_algs = MD5
Apr 14 13:30:15 user nova-compute[72019]: node.session.timeo.replacement_timeout = 120
Apr 14 13:30:15 user nova-compute[72019]: node.session.err_timeo.abort_timeout = 15
Apr 14 13:30:15 user nova-compute[72019]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 13:30:15 user nova-compute[72019]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 13:30:15 user nova-compute[72019]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 13:30:15 user nova-compute[72019]: node.session.iscsi.FastAbort = Yes
Apr 14 13:30:15 user nova-compute[72019]: node.session.iscsi.InitialR2T = No
Apr 14 13:30:15 user nova-compute[72019]: node.session.iscsi.ImmediateData = Yes
Apr 14 13:30:15 user nova-compute[72019]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 13:30:15 user nova-compute[72019]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 13:30:15 user nova-compute[72019]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 13:30:15 user nova-compute[72019]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 13:30:15 user nova-compute[72019]: node.session.iscsi.MaxConnections = 1
Apr 14 13:30:15 user nova-compute[72019]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 13:30:15 user nova-compute[72019]: node.session.iscsi.ERL = 0
Apr 14 13:30:15 user nova-compute[72019]: node.session.scan = manual
Apr 14 13:30:15 user nova-compute[72019]: node.session.reopen_max = 0
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].address = 172.16.0.220
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].port = 3260
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].startup = manual
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].tcp.window_size = 524288
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].tcp.type_of_service = 0
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].timeo.logout_timeout = 15
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].timeo.login_timeout = 15
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].timeo.auth_timeout = 45
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].iscsi.DataDigest = None
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].iscsi.IFMarker = No
Apr 14 13:30:15 user nova-compute[72019]: node.conn[0].iscsi.OFMarker = No
Apr 14 13:30:15 user nova-compute[72019]: # END RECORD
Apr 14 13:30:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2a66d3-6376-481e-a0e7-8fd422752cb6]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e697a9-0666-43f6-9bc8-6b1f252e6321]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JcFLujaY {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-f9ec552e-eaa2-4d05-9284-ee8f949bb7e8 req-7f623da7-45ac-4096-ab76-f26c047a92f5 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-unplugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f9ec552e-eaa2-4d05-9284-ee8f949bb7e8 req-7f623da7-45ac-4096-ab76-f26c047a92f5 service nova] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f9ec552e-eaa2-4d05-9284-ee8f949bb7e8 req-7f623da7-45ac-4096-ab76-f26c047a92f5 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f9ec552e-eaa2-4d05-9284-ee8f949bb7e8 req-7f623da7-45ac-4096-ab76-f26c047a92f5 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG nova.compute.manager [req-f9ec552e-eaa2-4d05-9284-ee8f949bb7e8 req-7f623da7-45ac-4096-ab76-f26c047a92f5 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] No waiting events found dispatching network-vif-unplugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:15 user nova-compute[72019]: WARNING nova.compute.manager [req-f9ec552e-eaa2-4d05-9284-ee8f949bb7e8 req-7f623da7-45ac-4096-ab76-f26c047a92f5 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received unexpected event network-vif-unplugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance with vm_state active and task_state shelving.
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JcFLujaY" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b68a15-70a4-47b9-875a-11e489a53aa3]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JcFLujaY'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbea1c6b-a683-4259-8f5b-cc54404d2d16]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7937d1f-4c3f-4a3e-ba60-4a0d77a0e6ba]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:30:15 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:30:15 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:30:15 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:30:15 user nova-compute[72019]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:30:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:30:15 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:30:15 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:30:15 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:30:15 user nova-compute[72019]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:30:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.190s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] HCTL ('37', '0', '0', 0) found on session 41 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG nova.network.neutron [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updated VIF entry in instance network info cache for port 2a3ecee8-e3fc-433e-81d5-f0c9decfd248. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG nova.network.neutron [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updating instance_info_cache with network_info: [{"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb97406-a64d-4e22-9b54-b68f620896c1]: (4, ('0 0 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Searching for a device in session 41 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcFLujaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.217s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] <== connect_volume: return (218ms) {'type': 'block', 'scsi_wwn': '23363363761323831', 'path': '/dev/sdf'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363363761323831', 'path': '/dev/sdf'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] Releasing lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1217180291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1217180291',id=39,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:28:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a573d19b775642bba2f2883e0005492d',ramdisk_id='',reservation_id='r-0hfp37ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-740277424',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:28:39Z,user_data=None,user_id='ebc2d46bc1794568841df20b046356c7',uuid=626abaa0-3f53-42cc-978e-21f0a80232fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "vif_mac": "fa:16:3e:15:c3:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converting VIF {"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "vif_mac": "fa:16:3e:15:c3:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:c3:18,bridge_name='br-int',has_traffic_filtering=True,id=7d5d9e2b-b502-494a-ac52-70930eda92ac,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5d9e2b-b5') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'pci_devices' on Instance uuid 626abaa0-3f53-42cc-978e-21f0a80232fa {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:30:15 user nova-compute[72019]:   <uuid>626abaa0-3f53-42cc-978e-21f0a80232fa</uuid>
Apr 14 13:30:15 user nova-compute[72019]:   <name>instance-00000027</name>
Apr 14 13:30:15 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:30:15 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:30:15 user nova-compute[72019]:   <metadata>
Apr 14 13:30:15 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:30:15 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:30:15 user nova-compute[72019]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1217180291</nova:name>
Apr 14 13:30:15 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:30:14</nova:creationTime>
Apr 14 13:30:15 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:30:15 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:30:15 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:30:15 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:30:15 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:30:15 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:30:15 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:30:15 user nova-compute[72019]:       <nova:owner>
Apr 14 13:30:15 user nova-compute[72019]:         <nova:user uuid="ebc2d46bc1794568841df20b046356c7">tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member</nova:user>
Apr 14 13:30:15 user nova-compute[72019]:         <nova:project uuid="a573d19b775642bba2f2883e0005492d">tempest-ServerBootFromVolumeStableRescueTest-740277424</nova:project>
Apr 14 13:30:15 user nova-compute[72019]:       </nova:owner>
Apr 14 13:30:15 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:30:15 user nova-compute[72019]:       <nova:ports>
Apr 14 13:30:15 user nova-compute[72019]:         <nova:port uuid="7d5d9e2b-b502-494a-ac52-70930eda92ac">
Apr 14 13:30:15 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 13:30:15 user nova-compute[72019]:         </nova:port>
Apr 14 13:30:15 user nova-compute[72019]:       </nova:ports>
Apr 14 13:30:15 user nova-compute[72019]:     </nova:instance>
Apr 14 13:30:15 user nova-compute[72019]:   </metadata>
Apr 14 13:30:15 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:30:15 user nova-compute[72019]:     <system>
Apr 14 13:30:15 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:30:15 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:30:15 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:30:15 user nova-compute[72019]:       <entry name="serial">626abaa0-3f53-42cc-978e-21f0a80232fa</entry>
Apr 14 13:30:15 user nova-compute[72019]:       <entry name="uuid">626abaa0-3f53-42cc-978e-21f0a80232fa</entry>
Apr 14 13:30:15 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:30:15 user nova-compute[72019]:     </system>
Apr 14 13:30:15 user nova-compute[72019]:   </sysinfo>
Apr 14 13:30:15 user nova-compute[72019]:   <os>
Apr 14 13:30:15 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:30:15 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:30:15 user nova-compute[72019]:   </os>
Apr 14 13:30:15 user nova-compute[72019]:   <features>
Apr 14 13:30:15 user nova-compute[72019]:     <acpi/>
Apr 14 13:30:15 user nova-compute[72019]:     <apic/>
Apr 14 13:30:15 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:30:15 user nova-compute[72019]:   </features>
Apr 14 13:30:15 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:30:15 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:30:15 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:30:15 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:30:15 user nova-compute[72019]:   </clock>
Apr 14 13:30:15 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:30:15 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:30:15 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:30:15 user nova-compute[72019]:   </cpu>
Apr 14 13:30:15 user nova-compute[72019]:   <devices>
Apr 14 13:30:15 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:30:15 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:30:15 user nova-compute[72019]:       <source dev="/dev/sdf"/>
Apr 14 13:30:15 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:30:15 user nova-compute[72019]:       <serial>4e65ce2e-31ed-49fb-81e0-dd8f8e767272</serial>
Apr 14 13:30:15 user nova-compute[72019]:     </disk>
Apr 14 13:30:15 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:30:15 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:30:15 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/disk.rescue"/>
Apr 14 13:30:15 user nova-compute[72019]:       <target dev="vdb" bus="virtio"/>
Apr 14 13:30:15 user nova-compute[72019]:       <boot order="1"/>
Apr 14 13:30:15 user nova-compute[72019]:     </disk>
Apr 14 13:30:15 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:30:15 user nova-compute[72019]:       <mac address="fa:16:3e:15:c3:18"/>
Apr 14 13:30:15 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:30:15 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:30:15 user nova-compute[72019]:       <target dev="tap7d5d9e2b-b5"/>
Apr 14 13:30:15 user nova-compute[72019]:     </interface>
Apr 14 13:30:15 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:30:15 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/console.log" append="off"/>
Apr 14 13:30:15 user nova-compute[72019]:     </serial>
Apr 14 13:30:15 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:30:15 user nova-compute[72019]:     <video>
Apr 14 13:30:15 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:30:15 user nova-compute[72019]:     </video>
Apr 14 13:30:15 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:30:15 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:30:15 user nova-compute[72019]:     </rng>
Apr 14 13:30:15 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:30:15 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:30:15 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:30:15 user nova-compute[72019]:     </memballoon>
Apr 14 13:30:15 user nova-compute[72019]:   </devices>
Apr 14 13:30:15 user nova-compute[72019]: </domain>
Apr 14 13:30:15 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:30:15 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Instance destroyed successfully.
Apr 14 13:30:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] No VIF found with MAC fa:16:3e:15:c3:18, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:16 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Instance destroyed successfully.
Apr 14 13:30:16 user nova-compute[72019]: DEBUG nova.compute.manager [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:30:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:30:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquired lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:30:16 user nova-compute[72019]: DEBUG nova.network.neutron [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:30:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:16 user nova-compute[72019]: DEBUG nova.network.neutron [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updating instance_info_cache with network_info: [{"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:30:16 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Releasing lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-aaa57fc2-7196-43b5-bd9b-5b98049eafc7 req-88fba1bc-a474-47be-ac84-fd1acce012a0 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aaa57fc2-7196-43b5-bd9b-5b98049eafc7 req-88fba1bc-a474-47be-ac84-fd1acce012a0 service nova] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aaa57fc2-7196-43b5-bd9b-5b98049eafc7 req-88fba1bc-a474-47be-ac84-fd1acce012a0 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aaa57fc2-7196-43b5-bd9b-5b98049eafc7 req-88fba1bc-a474-47be-ac84-fd1acce012a0 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-aaa57fc2-7196-43b5-bd9b-5b98049eafc7 req-88fba1bc-a474-47be-ac84-fd1acce012a0 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] No waiting events found dispatching network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:17 user nova-compute[72019]: WARNING nova.compute.manager [req-aaa57fc2-7196-43b5-bd9b-5b98049eafc7 req-88fba1bc-a474-47be-ac84-fd1acce012a0 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received unexpected event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance with vm_state active and task_state shelving.
Apr 14 13:30:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-33889b56-9e3c-4e08-9616-26a600e29bcb req-5483d33d-e202-4900-ae3f-ff66c7293e12 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-33889b56-9e3c-4e08-9616-26a600e29bcb req-5483d33d-e202-4900-ae3f-ff66c7293e12 service nova] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-33889b56-9e3c-4e08-9616-26a600e29bcb req-5483d33d-e202-4900-ae3f-ff66c7293e12 service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-33889b56-9e3c-4e08-9616-26a600e29bcb req-5483d33d-e202-4900-ae3f-ff66c7293e12 service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-33889b56-9e3c-4e08-9616-26a600e29bcb req-5483d33d-e202-4900-ae3f-ff66c7293e12 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] No waiting events found dispatching network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:17 user nova-compute[72019]: WARNING nova.compute.manager [req-33889b56-9e3c-4e08-9616-26a600e29bcb req-5483d33d-e202-4900-ae3f-ff66c7293e12 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received unexpected event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac for instance with vm_state active and task_state rescuing.
Apr 14 13:30:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhjgHKFR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:30:17 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:30:17 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:30:17 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f7e97e-5e7a-41a7-b9ba-b972aee1b9b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:30:17 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d7d57f-71e6-4b4f-9108-ecc84b2d33e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d] added
Apr 14 13:30:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1956162b-7834-446f-939f-82a4c109c6c8]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d44dc57-29c6-4d5f-921f-1df01d9844fe]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhjgHKFR {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhjgHKFR" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[99823df0-96fe-4d9b-b34c-3b82b0e891ca]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VhjgHKFR'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f7849d-9a69-4696-9a01-a7ebe463aa3b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d949a44c-a487-470b-a6fb-596ed5e297fa]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ef1c84-b0a6-439a-ad30-648b1d100b73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d, portal: 172.16.0.220,3260]
Apr 14 13:30:17 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d, portal: 172.16.0.220,3260] successful.
Apr 14 13:30:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f819a135-cd95-4a59-b971-222adc483c10]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fa3ede-41fc-44ad-b33e-f25940b92578]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:30:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:30:17 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:30:17 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] HCTL ('38', '-', '-', 0) found on session 44 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.038s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3e006c-dbc2-4ac0-8f5c-676e196d2e15]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Searching for a device in session 44 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:30:17 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhjgHKFR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:30:18 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Instance destroyed successfully.
Apr 14 13:30:18 user nova-compute[72019]: DEBUG nova.objects.instance [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lazy-loading 'resources' on Instance uuid 04cf64b3-e51b-418f-94f6-7597c4cd74bb {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-548766851',display_name='tempest-TestShelveInstance-server-548766851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-548766851',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIS8eIL/I3kxODqxFDmjVZgbwaBnYYyEpymoIT8frdOJIbK3dXh9J9GGKAL9gBIvS+6clwDRwZVCayK/ppHQaSnk+tDF7XA0oMOuQgWly6j9ws3NqPQ/uDU7zZbqKPJbIA==',key_name='tempest-TestShelveInstance-1155531040',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:28:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ba9f3b2ecb541aba4516734fdebd316',ramdisk_id='',reservation_id='r-6bf35sr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-615050191',owner_user_name='tempest-TestShelveInstance-615050191-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:28:33Z,user_data=None,user_id='01b25b886ade4e6ea689010d655d99a0',uuid=04cf64b3-e51b-418f-94f6-7597c4cd74bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Converting VIF {"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c4:3d,bridge_name='br-int',has_traffic_filtering=True,id=2a3ecee8-e3fc-433e-81d5-f0c9decfd248,network=Network(0a7d4ddd-e535-4d06-a605-a34d3ef8188c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3ecee8-e3') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG os_vif [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c4:3d,bridge_name='br-int',has_traffic_filtering=True,id=2a3ecee8-e3fc-433e-81d5-f0c9decfd248,network=Network(0a7d4ddd-e535-4d06-a605-a34d3ef8188c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3ecee8-e3') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a3ecee8-e3, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:30:18 user nova-compute[72019]: INFO os_vif [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c4:3d,bridge_name='br-int',has_traffic_filtering=True,id=2a3ecee8-e3fc-433e-81d5-f0c9decfd248,network=Network(0a7d4ddd-e535-4d06-a605-a34d3ef8188c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3ecee8-e3')
Apr 14 13:30:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAkcHOeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:30:18 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:30:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '26632353032373532', 'path': '/dev/sdg'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632353032373532', 'path': '/dev/sdg'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.546s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'flavor' on Instance uuid 9970f98b-ade9-4d08-a88d-b11a222adcf9 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9e1a63-be9c-4951-809d-7b09e2551754]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:30:18 user nova-compute[72019]: No targets found.
Apr 14 13:30:18 user nova-compute[72019]: iSNS:
Apr 14 13:30:18 user nova-compute[72019]: No targets found.
Apr 14 13:30:18 user nova-compute[72019]: STATIC:
Apr 14 13:30:18 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272
Apr 14 13:30:18 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:30:18 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:30:18 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d
Apr 14 13:30:18 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:30:18 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:30:18 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:30:18 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:30:18 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:30:18 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590
Apr 14 13:30:18 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:30:18 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:30:18 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4
Apr 14 13:30:18 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:30:18 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:30:18 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b
Apr 14 13:30:18 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:30:18 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:30:18 user nova-compute[72019]: FIRMWARE:
Apr 14 13:30:18 user nova-compute[72019]: No targets found.
Apr 14 13:30:18 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:30:18 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:30:18 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:30:18 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:30:18 user nova-compute[72019]:   <source dev="/dev/sdg"/>
Apr 14 13:30:18 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:30:18 user nova-compute[72019]:   <serial>3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d</serial>
Apr 14 13:30:18 user nova-compute[72019]: </disk>
Apr 14 13:30:18 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efacbe2-adda-4d61-bf56-8412c0ffe872]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d58d8f-35f7-4c03-b19b-d7e7220d6401]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:30:19 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:30:19 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:30:19 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:30:19 user nova-compute[72019]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:30:19 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:30:19 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:30:19 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:30:19 user nova-compute[72019]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:30:19 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:30:19 user nova-compute[72019]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:30:19 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:30:19 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7490442830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590'): ({'sde'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Removing single pathed devices sde {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0e08c9-d431-449d-8f1b-4e34499da7c9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c22f431-eda0-4fa6-a6f2-85d67cf1260f]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Flushing IO for device /dev/sde {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6669dc43-d6d8-4a36-bbb1-6f1d3000466b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dcfb61-2ca1-4563-b09b-322e413e796a]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd788cec-e4ff-473f-945e-a8d3edc8934a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a669d44-b6fe-4db2-ac57-d39bd11ee444]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260]
Apr 14 13:30:19 user nova-compute[72019]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260] successful.
Apr 14 13:30:19 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f1f458-5f31-4990-87b5-7aa40ccd5cae]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] <== disconnect_volume: return (888ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:30:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Deleting instance files /opt/stack/data/nova/instances/04cf64b3-e51b-418f-94f6-7597c4cd74bb_del
Apr 14 13:30:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Deletion of /opt/stack/data/nova/instances/04cf64b3-e51b-418f-94f6-7597c4cd74bb_del complete
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] No VIF found with MAC fa:16:3e:79:31:bf, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for 626abaa0-3f53-42cc-978e-21f0a80232fa due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479019.439397, 626abaa0-3f53-42cc-978e-21f0a80232fa => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:30:19 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] VM Resumed (Lifecycle Event)
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:30:19 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479019.4409091, 626abaa0-3f53-42cc-978e-21f0a80232fa => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:30:19 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] VM Started (Lifecycle Event)
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] No waiting events found dispatching network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:19 user nova-compute[72019]: WARNING nova.compute.manager [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received unexpected event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac for instance with vm_state active and task_state rescuing.
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-changed-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Refreshing instance network info cache due to event network-changed-2a3ecee8-e3fc-433e-81d5-f0c9decfd248. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] Acquiring lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] Acquired lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:30:19 user nova-compute[72019]: DEBUG nova.network.neutron [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Refreshing network info cache for port 2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:30:19 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 13:30:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.672s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:20 user nova-compute[72019]: DEBUG nova.network.neutron [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updated VIF entry in instance network info cache for port 2a3ecee8-e3fc-433e-81d5-f0c9decfd248. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:30:20 user nova-compute[72019]: DEBUG nova.network.neutron [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updating instance_info_cache with network_info: [{"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": null, "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:30:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] Releasing lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:30:20 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Deleted allocations for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb
Apr 14 13:30:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:20 user nova-compute[72019]: DEBUG nova.objects.instance [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lazy-loading 'numa_topology' on Instance uuid 04cf64b3-e51b-418f-94f6-7597c4cd74bb {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:30:20 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:30:20 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:30:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 6.178s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-8823844b-9c10-44bc-bb8a-47f42a471845 req-65e27a64-0330-4f42-80ab-cd8cb7b11478 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-changed-40073711-7679-449b-8856-60989099101c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:21 user nova-compute[72019]: DEBUG nova.compute.manager [req-8823844b-9c10-44bc-bb8a-47f42a471845 req-65e27a64-0330-4f42-80ab-cd8cb7b11478 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Refreshing instance network info cache due to event network-changed-40073711-7679-449b-8856-60989099101c. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:30:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8823844b-9c10-44bc-bb8a-47f42a471845 req-65e27a64-0330-4f42-80ab-cd8cb7b11478 service nova] Acquiring lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:30:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8823844b-9c10-44bc-bb8a-47f42a471845 req-65e27a64-0330-4f42-80ab-cd8cb7b11478 service nova] Acquired lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:30:21 user nova-compute[72019]: DEBUG nova.network.neutron [req-8823844b-9c10-44bc-bb8a-47f42a471845 req-65e27a64-0330-4f42-80ab-cd8cb7b11478 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Refreshing network info cache for port 40073711-7679-449b-8856-60989099101c {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:30:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:22 user nova-compute[72019]: DEBUG nova.network.neutron [req-8823844b-9c10-44bc-bb8a-47f42a471845 req-65e27a64-0330-4f42-80ab-cd8cb7b11478 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Updated VIF entry in instance network info cache for port 40073711-7679-449b-8856-60989099101c. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:30:22 user nova-compute[72019]: DEBUG nova.network.neutron [req-8823844b-9c10-44bc-bb8a-47f42a471845 req-65e27a64-0330-4f42-80ab-cd8cb7b11478 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Updating instance_info_cache with network_info: [{"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:30:22 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8823844b-9c10-44bc-bb8a-47f42a471845 req-65e27a64-0330-4f42-80ab-cd8cb7b11478 service nova] Releasing lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:30:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:24 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:30:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-ddea4e82-5ec0-4e4f-9e59-2a0c97516b02 req-edcd1825-319c-4b1f-bf4a-100e3cc63960 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-changed-40073711-7679-449b-8856-60989099101c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-ddea4e82-5ec0-4e4f-9e59-2a0c97516b02 req-edcd1825-319c-4b1f-bf4a-100e3cc63960 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Refreshing instance network info cache due to event network-changed-40073711-7679-449b-8856-60989099101c. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:30:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ddea4e82-5ec0-4e4f-9e59-2a0c97516b02 req-edcd1825-319c-4b1f-bf4a-100e3cc63960 service nova] Acquiring lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:30:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ddea4e82-5ec0-4e4f-9e59-2a0c97516b02 req-edcd1825-319c-4b1f-bf4a-100e3cc63960 service nova] Acquired lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:30:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-ddea4e82-5ec0-4e4f-9e59-2a0c97516b02 req-edcd1825-319c-4b1f-bf4a-100e3cc63960 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Refreshing network info cache for port 40073711-7679-449b-8856-60989099101c {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:30:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:25 user nova-compute[72019]: INFO nova.compute.manager [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Rebooting instance
Apr 14 13:30:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:30:25 user nova-compute[72019]: DEBUG nova.network.neutron [req-ddea4e82-5ec0-4e4f-9e59-2a0c97516b02 req-edcd1825-319c-4b1f-bf4a-100e3cc63960 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Updated VIF entry in instance network info cache for port 40073711-7679-449b-8856-60989099101c. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:30:25 user nova-compute[72019]: DEBUG nova.network.neutron [req-ddea4e82-5ec0-4e4f-9e59-2a0c97516b02 req-edcd1825-319c-4b1f-bf4a-100e3cc63960 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Updating instance_info_cache with network_info: [{"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:30:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ddea4e82-5ec0-4e4f-9e59-2a0c97516b02 req-edcd1825-319c-4b1f-bf4a-100e3cc63960 service nova] Releasing lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:30:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquired lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:30:25 user nova-compute[72019]: DEBUG nova.network.neutron [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:30:26 user nova-compute[72019]: DEBUG nova.network.neutron [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Updating instance_info_cache with network_info: [{"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:30:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Releasing lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:30:26 user nova-compute[72019]: DEBUG nova.compute.manager [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:30:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:28 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:30:28 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:30:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-7759119f-2d1a-4300-a72d-b1b4ec8d7750 req-e2ab22dd-d403-494f-8874-42b1919d60b0 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-vif-unplugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7759119f-2d1a-4300-a72d-b1b4ec8d7750 req-e2ab22dd-d403-494f-8874-42b1919d60b0 service nova] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7759119f-2d1a-4300-a72d-b1b4ec8d7750 req-e2ab22dd-d403-494f-8874-42b1919d60b0 service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7759119f-2d1a-4300-a72d-b1b4ec8d7750 req-e2ab22dd-d403-494f-8874-42b1919d60b0 service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-7759119f-2d1a-4300-a72d-b1b4ec8d7750 req-e2ab22dd-d403-494f-8874-42b1919d60b0 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] No waiting events found dispatching network-vif-unplugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:28 user nova-compute[72019]: WARNING nova.compute.manager [req-7759119f-2d1a-4300-a72d-b1b4ec8d7750 req-e2ab22dd-d403-494f-8874-42b1919d60b0 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received unexpected event network-vif-unplugged-40073711-7679-449b-8856-60989099101c for instance with vm_state active and task_state reboot_started.
Apr 14 13:30:29 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Instance shutdown successfully.
Apr 14 13:30:29 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:30:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:30:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-f4523ed5-6f7f-4b35-bae0-e80390f246d9 req-c37a8757-fa0a-428b-bbca-3f006030b525 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-vif-plugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f4523ed5-6f7f-4b35-bae0-e80390f246d9 req-c37a8757-fa0a-428b-bbca-3f006030b525 service nova] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f4523ed5-6f7f-4b35-bae0-e80390f246d9 req-c37a8757-fa0a-428b-bbca-3f006030b525 service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:30 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f4523ed5-6f7f-4b35-bae0-e80390f246d9 req-c37a8757-fa0a-428b-bbca-3f006030b525 service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:30 user nova-compute[72019]: DEBUG nova.compute.manager [req-f4523ed5-6f7f-4b35-bae0-e80390f246d9 req-c37a8757-fa0a-428b-bbca-3f006030b525 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] No waiting events found dispatching network-vif-plugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:30 user nova-compute[72019]: WARNING nova.compute.manager [req-f4523ed5-6f7f-4b35-bae0-e80390f246d9 req-c37a8757-fa0a-428b-bbca-3f006030b525 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received unexpected event network-vif-plugged-40073711-7679-449b-8856-60989099101c for instance with vm_state active and task_state reboot_started.
Apr 14 13:30:31 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479016.2981427, 04cf64b3-e51b-418f-94f6-7597c4cd74bb => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:30:31 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] VM Stopped (Lifecycle Event)
Apr 14 13:30:31 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ebf54649-067a-4c37-a0ad-1d39dc668483 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:30:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:31 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:30:31 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:30:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:30:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:30:31 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:30:32 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating instance_info_cache with network_info: [{"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:30:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-6e646c88-579e-4ea1-b987-da1c7194a064" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:30:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:30:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for 9970f98b-ade9-4d08-a88d-b11a222adcf9 due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479033.0908184, 9970f98b-ade9-4d08-a88d-b11a222adcf9 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:30:33 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] VM Resumed (Lifecycle Event)
Apr 14 13:30:33 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Instance running successfully.
Apr 14 13:30:33 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Instance soft rebooted successfully.
Apr 14 13:30:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-vif-plugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] No waiting events found dispatching network-vif-plugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:33 user nova-compute[72019]: WARNING nova.compute.manager [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received unexpected event network-vif-plugged-40073711-7679-449b-8856-60989099101c for instance with vm_state active and task_state reboot_started.
Apr 14 13:30:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-vif-plugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG nova.compute.manager [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] No waiting events found dispatching network-vif-plugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:33 user nova-compute[72019]: WARNING nova.compute.manager [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received unexpected event network-vif-plugged-40073711-7679-449b-8856-60989099101c for instance with vm_state active and task_state reboot_started.
Apr 14 13:30:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:30:33 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 14 13:30:33 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479033.0922563, 9970f98b-ade9-4d08-a88d-b11a222adcf9 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:30:33 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] VM Started (Lifecycle Event)
Apr 14 13:30:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.847s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:30:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:34 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:30:34 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:30:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:30:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:30:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:37 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:30:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:30:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:30:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:30:40 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:30:40 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:30:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7677MB free_disk=25.851295471191406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 626abaa0-3f53-42cc-978e-21f0a80232fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 167e06f3-4a3d-418d-8aaa-4827c749258d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 3c0f7d33-ba0c-4111-857d-319c5788106f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:30:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:30:41 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:30:41 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:30:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:30:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:47 user nova-compute[72019]: INFO nova.compute.manager [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Terminating instance
Apr 14 13:30:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:30:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG nova.compute.manager [req-fb43658a-e1cd-4bfe-bbed-32274dbe90f5 req-837ce780-fd67-4ff9-b4cc-190df03beb34 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received event network-vif-unplugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb43658a-e1cd-4bfe-bbed-32274dbe90f5 req-837ce780-fd67-4ff9-b4cc-190df03beb34 service nova] Acquiring lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb43658a-e1cd-4bfe-bbed-32274dbe90f5 req-837ce780-fd67-4ff9-b4cc-190df03beb34 service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fb43658a-e1cd-4bfe-bbed-32274dbe90f5 req-837ce780-fd67-4ff9-b4cc-190df03beb34 service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG nova.compute.manager [req-fb43658a-e1cd-4bfe-bbed-32274dbe90f5 req-837ce780-fd67-4ff9-b4cc-190df03beb34 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] No waiting events found dispatching network-vif-unplugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG nova.compute.manager [req-fb43658a-e1cd-4bfe-bbed-32274dbe90f5 req-837ce780-fd67-4ff9-b4cc-190df03beb34 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received event network-vif-unplugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:48 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Instance destroyed successfully.
Apr 14 13:30:48 user nova-compute[72019]: DEBUG nova.objects.instance [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'resources' on Instance uuid f7df0d0b-535b-4a60-a050-ddd6449e3c4d {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1289054872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1289054872',id=34,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM58epGqhtKxGXJ/+xFhEOxUulN613XjttUVnaW18pLMGQ2SIMhHBKaAkyjthPjHjJkakSAYkqQ670pGkRR5B7mIl8EE7DrTXrHs+Sy5Z42MrNXXIqNpGIAl9c8To2l2Sg==',key_name='tempest-keypair-321023180',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:29:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f0fee50983a4e31b1689dc77b1c4db1',ramdisk_id='',reservation_id='r-vz8bjy3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1344633518',owner_user_name='tempest-AttachVolumeShelveTestJSON-1344633518-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f04370605aec40a0a53a080c1e8bf8a8',uuid=f7df0d0b-535b-4a60-a050-ddd6449e3c4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converting VIF {"id": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "address": "fa:16:3e:d2:ff:1f", "network": {"id": "ce72cb91-222b-4491-af4a-bd9a67637d69", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-705539718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f0fee50983a4e31b1689dc77b1c4db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf56142-3e", "ovs_interfaceid": "3cf56142-3eb9-481f-9e81-b839a2106ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ff:1f,bridge_name='br-int',has_traffic_filtering=True,id=3cf56142-3eb9-481f-9e81-b839a2106ab3,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf56142-3e') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG os_vif [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ff:1f,bridge_name='br-int',has_traffic_filtering=True,id=3cf56142-3eb9-481f-9e81-b839a2106ab3,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf56142-3e') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cf56142-3e, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:30:48 user nova-compute[72019]: INFO os_vif [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ff:1f,bridge_name='br-int',has_traffic_filtering=True,id=3cf56142-3eb9-481f-9e81-b839a2106ab3,network=Network(ce72cb91-222b-4491-af4a-bd9a67637d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf56142-3e')
Apr 14 13:30:48 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Deleting instance files /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d_del
Apr 14 13:30:48 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Deletion of /opt/stack/data/nova/instances/f7df0d0b-535b-4a60-a050-ddd6449e3c4d_del complete
Apr 14 13:30:48 user nova-compute[72019]: INFO nova.compute.manager [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 13:30:48 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:30:48 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:30:49 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:30:49 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Took 0.81 seconds to deallocate network for instance.
Apr 14 13:30:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-34b9919e-96fd-4fc1-8d74-f388d3e9973a req-37ccb4e7-074e-476d-8340-16ae108dc344 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received event network-vif-deleted-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:49 user nova-compute[72019]: INFO nova.compute.manager [req-34b9919e-96fd-4fc1-8d74-f388d3e9973a req-37ccb4e7-074e-476d-8340-16ae108dc344 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Neutron deleted interface 3cf56142-3eb9-481f-9e81-b839a2106ab3; detaching it from the instance and deleting it from the info cache
Apr 14 13:30:49 user nova-compute[72019]: DEBUG nova.network.neutron [req-34b9919e-96fd-4fc1-8d74-f388d3e9973a req-37ccb4e7-074e-476d-8340-16ae108dc344 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:30:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-34b9919e-96fd-4fc1-8d74-f388d3e9973a req-37ccb4e7-074e-476d-8340-16ae108dc344 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Detach interface failed, port_id=3cf56142-3eb9-481f-9e81-b839a2106ab3, reason: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:30:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:49 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:30:49 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:30:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:49 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Deleted allocations for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d
Apr 14 13:30:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.174s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-c32286aa-b15a-4a2a-b02c-42be56251f79 req-5b6d5ec8-79d7-49e0-9eed-7ecf160c5308 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received event network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c32286aa-b15a-4a2a-b02c-42be56251f79 req-5b6d5ec8-79d7-49e0-9eed-7ecf160c5308 service nova] Acquiring lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c32286aa-b15a-4a2a-b02c-42be56251f79 req-5b6d5ec8-79d7-49e0-9eed-7ecf160c5308 service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c32286aa-b15a-4a2a-b02c-42be56251f79 req-5b6d5ec8-79d7-49e0-9eed-7ecf160c5308 service nova] Lock "f7df0d0b-535b-4a60-a050-ddd6449e3c4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-c32286aa-b15a-4a2a-b02c-42be56251f79 req-5b6d5ec8-79d7-49e0-9eed-7ecf160c5308 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] No waiting events found dispatching network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:50 user nova-compute[72019]: WARNING nova.compute.manager [req-c32286aa-b15a-4a2a-b02c-42be56251f79 req-5b6d5ec8-79d7-49e0-9eed-7ecf160c5308 service nova] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Received unexpected event network-vif-plugged-3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance with vm_state deleted and task_state None.
Apr 14 13:30:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:53 user nova-compute[72019]: INFO nova.compute.manager [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Terminating instance
Apr 14 13:30:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-4933f9aa-49c4-4a7c-95b7-8d0d05437403 req-a07d58bb-ed15-413c-95e5-cd4cf0206965 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4933f9aa-49c4-4a7c-95b7-8d0d05437403 req-a07d58bb-ed15-413c-95e5-cd4cf0206965 service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4933f9aa-49c4-4a7c-95b7-8d0d05437403 req-a07d58bb-ed15-413c-95e5-cd4cf0206965 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4933f9aa-49c4-4a7c-95b7-8d0d05437403 req-a07d58bb-ed15-413c-95e5-cd4cf0206965 service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-4933f9aa-49c4-4a7c-95b7-8d0d05437403 req-a07d58bb-ed15-413c-95e5-cd4cf0206965 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-4933f9aa-49c4-4a7c-95b7-8d0d05437403 req-a07d58bb-ed15-413c-95e5-cd4cf0206965 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-unplugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:30:54 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Instance destroyed successfully.
Apr 14 13:30:54 user nova-compute[72019]: DEBUG nova.objects.instance [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'resources' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1306609806',display_name='tempest-ServerActionsTestJSON-server-1057847197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1306609806',id=21,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:28:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-n0fqg6y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:28:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=6e646c88-579e-4ea1-b987-da1c7194a064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "address": "fa:16:3e:28:28:75", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b21f1a-fb", "ovs_interfaceid": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_vif [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25b21f1a-fb, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:54 user nova-compute[72019]: INFO os_vif [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:28:75,bridge_name='br-int',has_traffic_filtering=True,id=25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b21f1a-fb')
Apr 14 13:30:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlHAIzEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:30:54 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed678f5c-b750-4706-aabb-0c97edd3dd6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:30:54 user nova-compute[72019]: No targets found.
Apr 14 13:30:54 user nova-compute[72019]: iSNS:
Apr 14 13:30:54 user nova-compute[72019]: No targets found.
Apr 14 13:30:54 user nova-compute[72019]: STATIC:
Apr 14 13:30:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272
Apr 14 13:30:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:30:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:30:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d
Apr 14 13:30:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:30:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:30:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:30:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:30:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:30:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4
Apr 14 13:30:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:30:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:30:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b
Apr 14 13:30:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:30:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:30:54 user nova-compute[72019]: FIRMWARE:
Apr 14 13:30:54 user nova-compute[72019]: No targets found.
Apr 14 13:30:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:30:54 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:30:54 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae136b9-f2c2-44fc-aeae-27a6a825a988]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[da94ff40-05c9-4d86-b0e1-29213e1907ef]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:30:54 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:30:54 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:30:54 user nova-compute[72019]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:30:54 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:30:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:30:54 user nova-compute[72019]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b (non-flash)
Apr 14 13:30:54 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:30:54 user nova-compute[72019]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:30:54 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:30:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7490442e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b'): ({'sdb'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Removing single pathed devices sdb {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6786405f-a3e0-462d-a70b-9cb0af9d6f4f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[768cb43d-ce0c-4342-b36f-b96f4e7b1d17]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flushing IO for device /dev/sdb {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[716cf194-6fc9-47ba-ad66-d8b59da997e6]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39db661-6775-42b3-a78b-128bb0861ab6]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2db384-f352-413c-b675-d5c1f8364686]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fe6807-297c-4982-a5b1-2f1205e688e9]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260]
Apr 14 13:30:54 user nova-compute[72019]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b, portal: 172.16.0.220,3260] successful.
Apr 14 13:30:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3452b973-eab5-49dc-b950-2f515a6c4f1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3aecca-1a48-4cc8-8247-c9aff90f8e6f]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== disconnect_volume: return (326ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:30:54 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Deleting instance files /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064_del
Apr 14 13:30:54 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Deletion of /opt/stack/data/nova/instances/6e646c88-579e-4ea1-b987-da1c7194a064_del complete
Apr 14 13:30:54 user nova-compute[72019]: INFO nova.compute.manager [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 14 13:30:54 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:30:54 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:30:55 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:30:55 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Took 0.66 seconds to deallocate network for instance.
Apr 14 13:30:55 user nova-compute[72019]: DEBUG nova.compute.manager [req-613c411e-99cb-4512-9a7a-3624d7b950b6 req-bbaccf45-0ad0-44aa-b334-d8874f20b2f2 service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-deleted-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:55 user nova-compute[72019]: DEBUG nova.compute.manager [req-c92593c8-fe46-4a68-9e0e-f41367a0cc73 req-9dac6c5c-0fb0-491f-89df-47c0edc325cd service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:30:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c92593c8-fe46-4a68-9e0e-f41367a0cc73 req-9dac6c5c-0fb0-491f-89df-47c0edc325cd service nova] Acquiring lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c92593c8-fe46-4a68-9e0e-f41367a0cc73 req-9dac6c5c-0fb0-491f-89df-47c0edc325cd service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:55 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c92593c8-fe46-4a68-9e0e-f41367a0cc73 req-9dac6c5c-0fb0-491f-89df-47c0edc325cd service nova] Lock "6e646c88-579e-4ea1-b987-da1c7194a064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:55 user nova-compute[72019]: DEBUG nova.compute.manager [req-c92593c8-fe46-4a68-9e0e-f41367a0cc73 req-9dac6c5c-0fb0-491f-89df-47c0edc325cd service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] No waiting events found dispatching network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:30:55 user nova-compute[72019]: WARNING nova.compute.manager [req-c92593c8-fe46-4a68-9e0e-f41367a0cc73 req-9dac6c5c-0fb0-491f-89df-47c0edc325cd service nova] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Received unexpected event network-vif-plugged-25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance with vm_state active and task_state deleting.
Apr 14 13:30:56 user nova-compute[72019]: INFO nova.compute.manager [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Took 0.80 seconds to detach 1 volumes for instance.
Apr 14 13:30:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:30:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:30:56 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:30:56 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:30:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:56 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Deleted allocations for instance 6e646c88-579e-4ea1-b987-da1c7194a064
Apr 14 13:30:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "6e646c88-579e-4ea1-b987-da1c7194a064" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.193s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:30:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:30:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:03 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479048.4208703, f7df0d0b-535b-4a60-a050-ddd6449e3c4d => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:31:03 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] VM Stopped (Lifecycle Event)
Apr 14 13:31:03 user nova-compute[72019]: DEBUG nova.compute.manager [None req-814f846d-2c20-4874-817d-1cdaf270a9cc None None] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:31:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:09 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479054.261797, 6e646c88-579e-4ea1-b987-da1c7194a064 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:31:09 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] VM Stopped (Lifecycle Event)
Apr 14 13:31:09 user nova-compute[72019]: DEBUG nova.compute.manager [None req-bc5d89c5-4e13-4a58-8cae-e2c202d885f7 None None] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:31:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG nova.compute.manager [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:31:23 user nova-compute[72019]: INFO nova.compute.claims [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Claim successful on node user
Apr 14 13:31:23 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG nova.compute.manager [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG nova.compute.manager [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG nova.network.neutron [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:31:23 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:31:23 user nova-compute[72019]: DEBUG nova.compute.manager [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG nova.compute.manager [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:31:23 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Creating image(s)
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "/opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "/opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "/opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG nova.policy [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '140e52ed81ba492abc14653240501497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad49f75bbe9461b936963e8dc6c8be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk 1073741824" returned: 0 in 0.048s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.142s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Cannot resize image /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG nova.objects.instance [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'migration_context' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Ensure instance console log exists: /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:24 user nova-compute[72019]: DEBUG nova.network.neutron [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Successfully created port: 5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.network.neutron [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Successfully updated port: 5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquired lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.network.neutron [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-0f0d3f6b-efb4-40d9-86ee-9ba313dfb82c req-259ee0e6-617d-4265-8c7a-e306e8dcec90 service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Received event network-changed-5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-0f0d3f6b-efb4-40d9-86ee-9ba313dfb82c req-259ee0e6-617d-4265-8c7a-e306e8dcec90 service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Refreshing instance network info cache due to event network-changed-5670a4df-018a-4b12-bf37-a1fada7bfe9e. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0f0d3f6b-efb4-40d9-86ee-9ba313dfb82c req-259ee0e6-617d-4265-8c7a-e306e8dcec90 service nova] Acquiring lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.network.neutron [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.network.neutron [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Updating instance_info_cache with network_info: [{"id": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "address": "fa:16:3e:3e:80:6a", "network": {"id": "a9168d79-fcda-4f76-82db-8993f13bbff3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1548446165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad49f75bbe9461b936963e8dc6c8be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5670a4df-01", "ovs_interfaceid": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Releasing lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Instance network_info: |[{"id": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "address": "fa:16:3e:3e:80:6a", "network": {"id": "a9168d79-fcda-4f76-82db-8993f13bbff3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1548446165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad49f75bbe9461b936963e8dc6c8be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5670a4df-01", "ovs_interfaceid": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0f0d3f6b-efb4-40d9-86ee-9ba313dfb82c req-259ee0e6-617d-4265-8c7a-e306e8dcec90 service nova] Acquired lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.network.neutron [req-0f0d3f6b-efb4-40d9-86ee-9ba313dfb82c req-259ee0e6-617d-4265-8c7a-e306e8dcec90 service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Refreshing network info cache for port 5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Start _get_guest_xml network_info=[{"id": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "address": "fa:16:3e:3e:80:6a", "network": {"id": "a9168d79-fcda-4f76-82db-8993f13bbff3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1548446165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad49f75bbe9461b936963e8dc6c8be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5670a4df-01", "ovs_interfaceid": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:31:25 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:31:25 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-974413752',display_name='tempest-SnapshotDataIntegrityTests-server-974413752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-974413752',id=43,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSR12YULXM8FktIsw6D48vtD0MlDPkVgXWEj6z/53NfD2oP5/RwVMdTTqlNjMV3Dhgc2epCdqJMfyWAUa9Jl7/2VBBQxV/ej5ckBQg3W9NS3eh/ghhBOuxl3PShD/C2bw==',key_name='tempest-SnapshotDataIntegrityTests-495571124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ad49f75bbe9461b936963e8dc6c8be5',ramdisk_id='',reservation_id='r-k0pwn57g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1133806652',owner_user_name='tempest-SnapshotDataIntegrityTests-1133806652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:31:24Z,user_data=None,user_id='140e52ed81ba492abc14653240501497',uuid=03b76423-23ff-4721-8300-b198286c109a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "address": "fa:16:3e:3e:80:6a", "network": {"id": "a9168d79-fcda-4f76-82db-8993f13bbff3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1548446165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad49f75bbe9461b936963e8dc6c8be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5670a4df-01", "ovs_interfaceid": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Converting VIF {"id": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "address": "fa:16:3e:3e:80:6a", "network": {"id": "a9168d79-fcda-4f76-82db-8993f13bbff3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1548446165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad49f75bbe9461b936963e8dc6c8be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5670a4df-01", "ovs_interfaceid": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:80:6a,bridge_name='br-int',has_traffic_filtering=True,id=5670a4df-018a-4b12-bf37-a1fada7bfe9e,network=Network(a9168d79-fcda-4f76-82db-8993f13bbff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5670a4df-01') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.objects.instance [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'pci_devices' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:31:25 user nova-compute[72019]:   <uuid>03b76423-23ff-4721-8300-b198286c109a</uuid>
Apr 14 13:31:25 user nova-compute[72019]:   <name>instance-0000002b</name>
Apr 14 13:31:25 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:31:25 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:31:25 user nova-compute[72019]:   <metadata>
Apr 14 13:31:25 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:31:25 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:31:25 user nova-compute[72019]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-974413752</nova:name>
Apr 14 13:31:25 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:31:25</nova:creationTime>
Apr 14 13:31:25 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:31:25 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:31:25 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:31:25 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:31:25 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:31:25 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:31:25 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:31:25 user nova-compute[72019]:       <nova:owner>
Apr 14 13:31:25 user nova-compute[72019]:         <nova:user uuid="140e52ed81ba492abc14653240501497">tempest-SnapshotDataIntegrityTests-1133806652-project-member</nova:user>
Apr 14 13:31:25 user nova-compute[72019]:         <nova:project uuid="0ad49f75bbe9461b936963e8dc6c8be5">tempest-SnapshotDataIntegrityTests-1133806652</nova:project>
Apr 14 13:31:25 user nova-compute[72019]:       </nova:owner>
Apr 14 13:31:25 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:31:25 user nova-compute[72019]:       <nova:ports>
Apr 14 13:31:25 user nova-compute[72019]:         <nova:port uuid="5670a4df-018a-4b12-bf37-a1fada7bfe9e">
Apr 14 13:31:25 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 13:31:25 user nova-compute[72019]:         </nova:port>
Apr 14 13:31:25 user nova-compute[72019]:       </nova:ports>
Apr 14 13:31:25 user nova-compute[72019]:     </nova:instance>
Apr 14 13:31:25 user nova-compute[72019]:   </metadata>
Apr 14 13:31:25 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:31:25 user nova-compute[72019]:     <system>
Apr 14 13:31:25 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:31:25 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:31:25 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:31:25 user nova-compute[72019]:       <entry name="serial">03b76423-23ff-4721-8300-b198286c109a</entry>
Apr 14 13:31:25 user nova-compute[72019]:       <entry name="uuid">03b76423-23ff-4721-8300-b198286c109a</entry>
Apr 14 13:31:25 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:31:25 user nova-compute[72019]:     </system>
Apr 14 13:31:25 user nova-compute[72019]:   </sysinfo>
Apr 14 13:31:25 user nova-compute[72019]:   <os>
Apr 14 13:31:25 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:31:25 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:31:25 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:31:25 user nova-compute[72019]:   </os>
Apr 14 13:31:25 user nova-compute[72019]:   <features>
Apr 14 13:31:25 user nova-compute[72019]:     <acpi/>
Apr 14 13:31:25 user nova-compute[72019]:     <apic/>
Apr 14 13:31:25 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:31:25 user nova-compute[72019]:   </features>
Apr 14 13:31:25 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:31:25 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:31:25 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:31:25 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:31:25 user nova-compute[72019]:   </clock>
Apr 14 13:31:25 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:31:25 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:31:25 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:31:25 user nova-compute[72019]:   </cpu>
Apr 14 13:31:25 user nova-compute[72019]:   <devices>
Apr 14 13:31:25 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:31:25 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:31:25 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk"/>
Apr 14 13:31:25 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:31:25 user nova-compute[72019]:     </disk>
Apr 14 13:31:25 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:31:25 user nova-compute[72019]:       <mac address="fa:16:3e:3e:80:6a"/>
Apr 14 13:31:25 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:31:25 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:31:25 user nova-compute[72019]:       <target dev="tap5670a4df-01"/>
Apr 14 13:31:25 user nova-compute[72019]:     </interface>
Apr 14 13:31:25 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:31:25 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/console.log" append="off"/>
Apr 14 13:31:25 user nova-compute[72019]:     </serial>
Apr 14 13:31:25 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:31:25 user nova-compute[72019]:     <video>
Apr 14 13:31:25 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:31:25 user nova-compute[72019]:     </video>
Apr 14 13:31:25 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:31:25 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:31:25 user nova-compute[72019]:     </rng>
Apr 14 13:31:25 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:31:25 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:31:25 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:31:25 user nova-compute[72019]:     </memballoon>
Apr 14 13:31:25 user nova-compute[72019]:   </devices>
Apr 14 13:31:25 user nova-compute[72019]: </domain>
Apr 14 13:31:25 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-974413752',display_name='tempest-SnapshotDataIntegrityTests-server-974413752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-974413752',id=43,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSR12YULXM8FktIsw6D48vtD0MlDPkVgXWEj6z/53NfD2oP5/RwVMdTTqlNjMV3Dhgc2epCdqJMfyWAUa9Jl7/2VBBQxV/ej5ckBQg3W9NS3eh/ghhBOuxl3PShD/C2bw==',key_name='tempest-SnapshotDataIntegrityTests-495571124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ad49f75bbe9461b936963e8dc6c8be5',ramdisk_id='',reservation_id='r-k0pwn57g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1133806652',owner_user_name='tempest-SnapshotDataIntegrityTests-1133806652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:31:24Z,user_data=None,user_id='140e52ed81ba492abc14653240501497',uuid=03b76423-23ff-4721-8300-b198286c109a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "address": "fa:16:3e:3e:80:6a", "network": {"id": "a9168d79-fcda-4f76-82db-8993f13bbff3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1548446165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad49f75bbe9461b936963e8dc6c8be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5670a4df-01", "ovs_interfaceid": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Converting VIF {"id": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "address": "fa:16:3e:3e:80:6a", "network": {"id": "a9168d79-fcda-4f76-82db-8993f13bbff3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1548446165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad49f75bbe9461b936963e8dc6c8be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5670a4df-01", "ovs_interfaceid": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:80:6a,bridge_name='br-int',has_traffic_filtering=True,id=5670a4df-018a-4b12-bf37-a1fada7bfe9e,network=Network(a9168d79-fcda-4f76-82db-8993f13bbff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5670a4df-01') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG os_vif [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:80:6a,bridge_name='br-int',has_traffic_filtering=True,id=5670a4df-018a-4b12-bf37-a1fada7bfe9e,network=Network(a9168d79-fcda-4f76-82db-8993f13bbff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5670a4df-01') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5670a4df-01, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5670a4df-01, col_values=(('external_ids', {'iface-id': '5670a4df-018a-4b12-bf37-a1fada7bfe9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:80:6a', 'vm-uuid': '03b76423-23ff-4721-8300-b198286c109a'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:25 user nova-compute[72019]: INFO os_vif [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:80:6a,bridge_name='br-int',has_traffic_filtering=True,id=5670a4df-018a-4b12-bf37-a1fada7bfe9e,network=Network(a9168d79-fcda-4f76-82db-8993f13bbff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5670a4df-01')
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:31:25 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] No VIF found with MAC fa:16:3e:3e:80:6a, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:31:26 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:31:26 user nova-compute[72019]: DEBUG nova.network.neutron [req-0f0d3f6b-efb4-40d9-86ee-9ba313dfb82c req-259ee0e6-617d-4265-8c7a-e306e8dcec90 service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Updated VIF entry in instance network info cache for port 5670a4df-018a-4b12-bf37-a1fada7bfe9e. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:31:26 user nova-compute[72019]: DEBUG nova.network.neutron [req-0f0d3f6b-efb4-40d9-86ee-9ba313dfb82c req-259ee0e6-617d-4265-8c7a-e306e8dcec90 service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Updating instance_info_cache with network_info: [{"id": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "address": "fa:16:3e:3e:80:6a", "network": {"id": "a9168d79-fcda-4f76-82db-8993f13bbff3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1548446165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad49f75bbe9461b936963e8dc6c8be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5670a4df-01", "ovs_interfaceid": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:31:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0f0d3f6b-efb4-40d9-86ee-9ba313dfb82c req-259ee0e6-617d-4265-8c7a-e306e8dcec90 service nova] Releasing lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:31:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:27 user nova-compute[72019]: DEBUG nova.compute.manager [req-98d1cb5d-7488-4689-adb3-532d58f90abe req-64c2ed81-5691-4f27-83d0-bbe16aca0909 service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Received event network-vif-plugged-5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:31:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-98d1cb5d-7488-4689-adb3-532d58f90abe req-64c2ed81-5691-4f27-83d0-bbe16aca0909 service nova] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-98d1cb5d-7488-4689-adb3-532d58f90abe req-64c2ed81-5691-4f27-83d0-bbe16aca0909 service nova] Lock "03b76423-23ff-4721-8300-b198286c109a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-98d1cb5d-7488-4689-adb3-532d58f90abe req-64c2ed81-5691-4f27-83d0-bbe16aca0909 service nova] Lock "03b76423-23ff-4721-8300-b198286c109a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:27 user nova-compute[72019]: DEBUG nova.compute.manager [req-98d1cb5d-7488-4689-adb3-532d58f90abe req-64c2ed81-5691-4f27-83d0-bbe16aca0909 service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] No waiting events found dispatching network-vif-plugged-5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:31:27 user nova-compute[72019]: WARNING nova.compute.manager [req-98d1cb5d-7488-4689-adb3-532d58f90abe req-64c2ed81-5691-4f27-83d0-bbe16aca0909 service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Received unexpected event network-vif-plugged-5670a4df-018a-4b12-bf37-a1fada7bfe9e for instance with vm_state building and task_state spawning.
Apr 14 13:31:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479089.2857974, 03b76423-23ff-4721-8300-b198286c109a => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:31:29 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 03b76423-23ff-4721-8300-b198286c109a] VM Resumed (Lifecycle Event)
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.compute.manager [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:31:29 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 03b76423-23ff-4721-8300-b198286c109a] Instance spawned successfully.
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 03b76423-23ff-4721-8300-b198286c109a] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 03b76423-23ff-4721-8300-b198286c109a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:31:29 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 03b76423-23ff-4721-8300-b198286c109a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479089.287081, 03b76423-23ff-4721-8300-b198286c109a => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:31:29 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 03b76423-23ff-4721-8300-b198286c109a] VM Started (Lifecycle Event)
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 03b76423-23ff-4721-8300-b198286c109a] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 03b76423-23ff-4721-8300-b198286c109a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:31:29 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 03b76423-23ff-4721-8300-b198286c109a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:31:29 user nova-compute[72019]: INFO nova.compute.manager [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Took 5.70 seconds to spawn the instance on the hypervisor.
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.compute.manager [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:31:29 user nova-compute[72019]: INFO nova.compute.manager [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Took 6.39 seconds to build instance.
Apr 14 13:31:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.479s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-51ecdea3-861c-4dff-9dae-84288cff8a4a req-d73bc9ab-3289-4999-8513-6ff92dd9ae0e service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Received event network-vif-plugged-5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-51ecdea3-861c-4dff-9dae-84288cff8a4a req-d73bc9ab-3289-4999-8513-6ff92dd9ae0e service nova] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-51ecdea3-861c-4dff-9dae-84288cff8a4a req-d73bc9ab-3289-4999-8513-6ff92dd9ae0e service nova] Lock "03b76423-23ff-4721-8300-b198286c109a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-51ecdea3-861c-4dff-9dae-84288cff8a4a req-d73bc9ab-3289-4999-8513-6ff92dd9ae0e service nova] Lock "03b76423-23ff-4721-8300-b198286c109a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:29 user nova-compute[72019]: DEBUG nova.compute.manager [req-51ecdea3-861c-4dff-9dae-84288cff8a4a req-d73bc9ab-3289-4999-8513-6ff92dd9ae0e service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] No waiting events found dispatching network-vif-plugged-5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:31:29 user nova-compute[72019]: WARNING nova.compute.manager [req-51ecdea3-861c-4dff-9dae-84288cff8a4a req-d73bc9ab-3289-4999-8513-6ff92dd9ae0e service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Received unexpected event network-vif-plugged-5670a4df-018a-4b12-bf37-a1fada7bfe9e for instance with vm_state active and task_state None.
Apr 14 13:31:29 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:31:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:31:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:31 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:31:31 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:31:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:31:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:31:31 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:31:32 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Updating instance_info_cache with network_info: [{"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:31:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-b7cdf352-a517-4296-bc70-400836915095" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:31:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:31:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:31:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:34 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:31:34 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:31:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:31:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:37 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:31:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:37 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:31:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:37 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:31:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/disk.rescue --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-144d945c-3c0e-4f33-bd82-961cc62cbcbb req-a228f138-0810-4665-9f2d-026d83c03c95 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Received event network-changed-94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG nova.compute.manager [req-144d945c-3c0e-4f33-bd82-961cc62cbcbb req-a228f138-0810-4665-9f2d-026d83c03c95 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Refreshing instance network info cache due to event network-changed-94fca401-a6e6-49b4-bdf9-4419787e733e. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-144d945c-3c0e-4f33-bd82-961cc62cbcbb req-a228f138-0810-4665-9f2d-026d83c03c95 service nova] Acquiring lock "refresh_cache-167e06f3-4a3d-418d-8aaa-4827c749258d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-144d945c-3c0e-4f33-bd82-961cc62cbcbb req-a228f138-0810-4665-9f2d-026d83c03c95 service nova] Acquired lock "refresh_cache-167e06f3-4a3d-418d-8aaa-4827c749258d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG nova.network.neutron [req-144d945c-3c0e-4f33-bd82-961cc62cbcbb req-a228f138-0810-4665-9f2d-026d83c03c95 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Refreshing network info cache for port 94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "167e06f3-4a3d-418d-8aaa-4827c749258d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "167e06f3-4a3d-418d-8aaa-4827c749258d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:39 user nova-compute[72019]: INFO nova.compute.manager [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Terminating instance
Apr 14 13:31:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG nova.compute.manager [req-ff152872-96a0-4750-8c51-aad3e039dbbf req-b94b5982-c9e4-4966-bd27-f8136e995da3 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Received event network-vif-unplugged-94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ff152872-96a0-4750-8c51-aad3e039dbbf req-b94b5982-c9e4-4966-bd27-f8136e995da3 service nova] Acquiring lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ff152872-96a0-4750-8c51-aad3e039dbbf req-b94b5982-c9e4-4966-bd27-f8136e995da3 service nova] Lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ff152872-96a0-4750-8c51-aad3e039dbbf req-b94b5982-c9e4-4966-bd27-f8136e995da3 service nova] Lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG nova.compute.manager [req-ff152872-96a0-4750-8c51-aad3e039dbbf req-b94b5982-c9e4-4966-bd27-f8136e995da3 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] No waiting events found dispatching network-vif-unplugged-94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG nova.compute.manager [req-ff152872-96a0-4750-8c51-aad3e039dbbf req-b94b5982-c9e4-4966-bd27-f8136e995da3 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Received event network-vif-unplugged-94fca401-a6e6-49b4-bdf9-4419787e733e for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG nova.network.neutron [req-144d945c-3c0e-4f33-bd82-961cc62cbcbb req-a228f138-0810-4665-9f2d-026d83c03c95 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Updated VIF entry in instance network info cache for port 94fca401-a6e6-49b4-bdf9-4419787e733e. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG nova.network.neutron [req-144d945c-3c0e-4f33-bd82-961cc62cbcbb req-a228f138-0810-4665-9f2d-026d83c03c95 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Updating instance_info_cache with network_info: [{"id": "94fca401-a6e6-49b4-bdf9-4419787e733e", "address": "fa:16:3e:87:a8:bb", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fca401-a6", "ovs_interfaceid": "94fca401-a6e6-49b4-bdf9-4419787e733e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-144d945c-3c0e-4f33-bd82-961cc62cbcbb req-a228f138-0810-4665-9f2d-026d83c03c95 service nova] Releasing lock "refresh_cache-167e06f3-4a3d-418d-8aaa-4827c749258d" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:31:40 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Instance destroyed successfully.
Apr 14 13:31:40 user nova-compute[72019]: DEBUG nova.objects.instance [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lazy-loading 'resources' on Instance uuid 167e06f3-4a3d-418d-8aaa-4827c749258d {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1166522692',display_name='tempest-TestVolumeBootPattern-server-1166522692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1166522692',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn0p0IUuVWoQy0dGsU9Pfuky6ks2ZRYQtS2s2AMQUPgWS/ZFj3/9xG//6C/vHeESCtbDFovyBlscNk5g1knYdZi4/iSS7XffFRPqq5TMnScynxdTnC9z463yGcQBrDWEQ==',key_name='tempest-TestVolumeBootPattern-212867192',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:29:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-1mlvjgfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:29:56Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=167e06f3-4a3d-418d-8aaa-4827c749258d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94fca401-a6e6-49b4-bdf9-4419787e733e", "address": "fa:16:3e:87:a8:bb", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fca401-a6", "ovs_interfaceid": "94fca401-a6e6-49b4-bdf9-4419787e733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "94fca401-a6e6-49b4-bdf9-4419787e733e", "address": "fa:16:3e:87:a8:bb", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fca401-a6", "ovs_interfaceid": "94fca401-a6e6-49b4-bdf9-4419787e733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:a8:bb,bridge_name='br-int',has_traffic_filtering=True,id=94fca401-a6e6-49b4-bdf9-4419787e733e,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fca401-a6') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG os_vif [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:a8:bb,bridge_name='br-int',has_traffic_filtering=True,id=94fca401-a6e6-49b4-bdf9-4419787e733e,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fca401-a6') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94fca401-a6, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:31:41 user nova-compute[72019]: INFO os_vif [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:a8:bb,bridge_name='br-int',has_traffic_filtering=True,id=94fca401-a6e6-49b4-bdf9-4419787e733e,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fca401-a6')
Apr 14 13:31:41 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:31:41 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7802MB free_disk=25.878639221191406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnhPHgQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:31:41 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0fcd43-5306-4aef-aa73-b19b9f3aea58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:31:41 user nova-compute[72019]: No targets found.
Apr 14 13:31:41 user nova-compute[72019]: iSNS:
Apr 14 13:31:41 user nova-compute[72019]: No targets found.
Apr 14 13:31:41 user nova-compute[72019]: STATIC:
Apr 14 13:31:41 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272
Apr 14 13:31:41 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:31:41 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:31:41 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d
Apr 14 13:31:41 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:31:41 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:31:41 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:31:41 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:31:41 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:31:41 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4
Apr 14 13:31:41 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:31:41 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:31:41 user nova-compute[72019]: FIRMWARE:
Apr 14 13:31:41 user nova-compute[72019]: No targets found.
Apr 14 13:31:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:31:41 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:31:41 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[29173e5e-f38d-4edc-9921-c0e73ec4cc40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a98ac4-8e3c-4257-9f63-2ecd15060e37]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:31:41 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:31:41 user nova-compute[72019]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:31:41 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:31:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:31:41 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:31:41 user nova-compute[72019]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:31:41 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:31:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f749024ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4'): ({'sdd'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Removing single pathed devices sdd {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d065e8e6-7d71-458e-a5a9-ef982e9b5ec6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 626abaa0-3f53-42cc-978e-21f0a80232fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 167e06f3-4a3d-418d-8aaa-4827c749258d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 3c0f7d33-ba0c-4111-857d-319c5788106f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 03b76423-23ff-4721-8300-b198286c109a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f01a09-eee3-4278-817f-a87767e92bfc]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flushing IO for device /dev/sdd {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99d3c16-9a2c-4c92-baf1-ece254f4a3dc]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[072f4d69-02ed-415b-bc6c-68da3b875fdb]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] SCSI volumes sdd have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01c95b9-53c6-43c5-a7e6-9621eaaaf667]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c58a6a-36ac-4943-b18f-100244c89457]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260]
Apr 14 13:31:41 user nova-compute[72019]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260] successful.
Apr 14 13:31:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da9d756-3fe8-456d-ad86-bfc4534a0caf]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== disconnect_volume: return (355ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:31:41 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Deleting instance files /opt/stack/data/nova/instances/167e06f3-4a3d-418d-8aaa-4827c749258d_del
Apr 14 13:31:41 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Deletion of /opt/stack/data/nova/instances/167e06f3-4a3d-418d-8aaa-4827c749258d_del complete
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:31:41 user nova-compute[72019]: INFO nova.compute.manager [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Took 1.94 seconds to destroy the instance on the hypervisor.
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:31:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:42 user nova-compute[72019]: DEBUG nova.compute.manager [req-eb04a153-0157-458e-a3d0-ef6821065419 req-d3fb1ac1-9bbc-4046-acb1-5b8a02cd59df service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Received event network-vif-plugged-94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:31:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-eb04a153-0157-458e-a3d0-ef6821065419 req-d3fb1ac1-9bbc-4046-acb1-5b8a02cd59df service nova] Acquiring lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-eb04a153-0157-458e-a3d0-ef6821065419 req-d3fb1ac1-9bbc-4046-acb1-5b8a02cd59df service nova] Lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-eb04a153-0157-458e-a3d0-ef6821065419 req-d3fb1ac1-9bbc-4046-acb1-5b8a02cd59df service nova] Lock "167e06f3-4a3d-418d-8aaa-4827c749258d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:42 user nova-compute[72019]: DEBUG nova.compute.manager [req-eb04a153-0157-458e-a3d0-ef6821065419 req-d3fb1ac1-9bbc-4046-acb1-5b8a02cd59df service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] No waiting events found dispatching network-vif-plugged-94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:31:42 user nova-compute[72019]: WARNING nova.compute.manager [req-eb04a153-0157-458e-a3d0-ef6821065419 req-d3fb1ac1-9bbc-4046-acb1-5b8a02cd59df service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Received unexpected event network-vif-plugged-94fca401-a6e6-49b4-bdf9-4419787e733e for instance with vm_state active and task_state deleting.
Apr 14 13:31:42 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:31:42 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:31:42 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Took 1.09 seconds to deallocate network for instance.
Apr 14 13:31:43 user nova-compute[72019]: INFO nova.compute.manager [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Took 0.79 seconds to detach 1 volumes for instance.
Apr 14 13:31:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:43 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:31:43 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:31:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:43 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Deleted allocations for instance 167e06f3-4a3d-418d-8aaa-4827c749258d
Apr 14 13:31:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "167e06f3-4a3d-418d-8aaa-4827c749258d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.351s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:44 user nova-compute[72019]: DEBUG nova.compute.manager [req-536af45d-fe5b-4106-b4b0-f09d04a2007d req-415d978d-4f69-4117-8733-ef74ef6b62c2 service nova] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Received event network-vif-deleted-94fca401-a6e6-49b4-bdf9-4419787e733e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:31:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "fe769254-aa7a-4038-abb6-18628dbcd227" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "fe769254-aa7a-4038-abb6-18628dbcd227" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:31:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:45 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:31:45 user nova-compute[72019]: INFO nova.compute.claims [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Claim successful on node user
Apr 14 13:31:45 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:31:45 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:31:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:31:46 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:31:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG nova.policy [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:31:46 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Creating image(s)
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "/opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "/opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.151s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk 1073741824 {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d,backing_fmt=raw /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk 1073741824" returned: 0 in 0.059s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "4d1824f5d2b6dfc2752a67897fd4b12bc34c684d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d1824f5d2b6dfc2752a67897fd4b12bc34c684d --force-share --output=json" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk. size=1073741824 {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Successfully created port: 08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG nova.virt.disk.api [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Cannot resize image /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk to a smaller size. {{(pid=72019) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'migration_context' on Instance uuid fe769254-aa7a-4038-abb6-18628dbcd227 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Created local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Ensure instance console log exists: /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Successfully updated port: 08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:31:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:31:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquired lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:31:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:31:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-125b9ce9-a4df-4e77-9c9c-5fe54b104db7 req-1540aa7a-6fcc-4514-b53e-dc5e36befe82 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Received event network-changed-08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:31:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-125b9ce9-a4df-4e77-9c9c-5fe54b104db7 req-1540aa7a-6fcc-4514-b53e-dc5e36befe82 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Refreshing instance network info cache due to event network-changed-08aca6e2-fbdf-43c4-878a-45558c029e27. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:31:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-125b9ce9-a4df-4e77-9c9c-5fe54b104db7 req-1540aa7a-6fcc-4514-b53e-dc5e36befe82 service nova] Acquiring lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:31:47 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.network.neutron [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updating instance_info_cache with network_info: [{"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Releasing lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Instance network_info: |[{"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-125b9ce9-a4df-4e77-9c9c-5fe54b104db7 req-1540aa7a-6fcc-4514-b53e-dc5e36befe82 service nova] Acquired lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-125b9ce9-a4df-4e77-9c9c-5fe54b104db7 req-1540aa7a-6fcc-4514-b53e-dc5e36befe82 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Refreshing network info cache for port 08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Start _get_guest_xml network_info=[{"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'image_id': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:31:48 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:31:48 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T13:08:39Z,direct_url=<?>,disk_format='qcow2',id=364f8f0e-9be3-4fd9-80d8-be290e16b4b1,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ae9501805cab47aaa3a6e2553987bd27',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T13:08:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-53409261',display_name='tempest-ServerActionsTestJSON-server-53409261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-53409261',id=44,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-i6j556h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=fe769254-aa7a-4038-abb6-18628dbcd227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:62:9e,bridge_name='br-int',has_traffic_filtering=True,id=08aca6e2-fbdf-43c4-878a-45558c029e27,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08aca6e2-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'pci_devices' on Instance uuid fe769254-aa7a-4038-abb6-18628dbcd227 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:31:48 user nova-compute[72019]:   <uuid>fe769254-aa7a-4038-abb6-18628dbcd227</uuid>
Apr 14 13:31:48 user nova-compute[72019]:   <name>instance-0000002c</name>
Apr 14 13:31:48 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:31:48 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:31:48 user nova-compute[72019]:   <metadata>
Apr 14 13:31:48 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:31:48 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:31:48 user nova-compute[72019]:       <nova:name>tempest-ServerActionsTestJSON-server-53409261</nova:name>
Apr 14 13:31:48 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:31:48</nova:creationTime>
Apr 14 13:31:48 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:31:48 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:31:48 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:31:48 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:31:48 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:31:48 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:31:48 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:31:48 user nova-compute[72019]:       <nova:owner>
Apr 14 13:31:48 user nova-compute[72019]:         <nova:user uuid="9169729edbd04fd5a74d2cffd0aa437f">tempest-ServerActionsTestJSON-1929049437-project-member</nova:user>
Apr 14 13:31:48 user nova-compute[72019]:         <nova:project uuid="4b197f1df57f4dee9757639cf861eb97">tempest-ServerActionsTestJSON-1929049437</nova:project>
Apr 14 13:31:48 user nova-compute[72019]:       </nova:owner>
Apr 14 13:31:48 user nova-compute[72019]:       <nova:root type="image" uuid="364f8f0e-9be3-4fd9-80d8-be290e16b4b1"/>
Apr 14 13:31:48 user nova-compute[72019]:       <nova:ports>
Apr 14 13:31:48 user nova-compute[72019]:         <nova:port uuid="08aca6e2-fbdf-43c4-878a-45558c029e27">
Apr 14 13:31:48 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 13:31:48 user nova-compute[72019]:         </nova:port>
Apr 14 13:31:48 user nova-compute[72019]:       </nova:ports>
Apr 14 13:31:48 user nova-compute[72019]:     </nova:instance>
Apr 14 13:31:48 user nova-compute[72019]:   </metadata>
Apr 14 13:31:48 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:31:48 user nova-compute[72019]:     <system>
Apr 14 13:31:48 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:31:48 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:31:48 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:31:48 user nova-compute[72019]:       <entry name="serial">fe769254-aa7a-4038-abb6-18628dbcd227</entry>
Apr 14 13:31:48 user nova-compute[72019]:       <entry name="uuid">fe769254-aa7a-4038-abb6-18628dbcd227</entry>
Apr 14 13:31:48 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:31:48 user nova-compute[72019]:     </system>
Apr 14 13:31:48 user nova-compute[72019]:   </sysinfo>
Apr 14 13:31:48 user nova-compute[72019]:   <os>
Apr 14 13:31:48 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:31:48 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:31:48 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:31:48 user nova-compute[72019]:   </os>
Apr 14 13:31:48 user nova-compute[72019]:   <features>
Apr 14 13:31:48 user nova-compute[72019]:     <acpi/>
Apr 14 13:31:48 user nova-compute[72019]:     <apic/>
Apr 14 13:31:48 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:31:48 user nova-compute[72019]:   </features>
Apr 14 13:31:48 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:31:48 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:31:48 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:31:48 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:31:48 user nova-compute[72019]:   </clock>
Apr 14 13:31:48 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:31:48 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:31:48 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:31:48 user nova-compute[72019]:   </cpu>
Apr 14 13:31:48 user nova-compute[72019]:   <devices>
Apr 14 13:31:48 user nova-compute[72019]:     <disk type="file" device="disk">
Apr 14 13:31:48 user nova-compute[72019]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 13:31:48 user nova-compute[72019]:       <source file="/opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk"/>
Apr 14 13:31:48 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:31:48 user nova-compute[72019]:     </disk>
Apr 14 13:31:48 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:31:48 user nova-compute[72019]:       <mac address="fa:16:3e:5b:62:9e"/>
Apr 14 13:31:48 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:31:48 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:31:48 user nova-compute[72019]:       <target dev="tap08aca6e2-fb"/>
Apr 14 13:31:48 user nova-compute[72019]:     </interface>
Apr 14 13:31:48 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:31:48 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/console.log" append="off"/>
Apr 14 13:31:48 user nova-compute[72019]:     </serial>
Apr 14 13:31:48 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:31:48 user nova-compute[72019]:     <video>
Apr 14 13:31:48 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:31:48 user nova-compute[72019]:     </video>
Apr 14 13:31:48 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:31:48 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:31:48 user nova-compute[72019]:     </rng>
Apr 14 13:31:48 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:31:48 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:31:48 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:31:48 user nova-compute[72019]:     </memballoon>
Apr 14 13:31:48 user nova-compute[72019]:   </devices>
Apr 14 13:31:48 user nova-compute[72019]: </domain>
Apr 14 13:31:48 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-53409261',display_name='tempest-ServerActionsTestJSON-server-53409261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-53409261',id=44,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-i6j556h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=fe769254-aa7a-4038-abb6-18628dbcd227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:62:9e,bridge_name='br-int',has_traffic_filtering=True,id=08aca6e2-fbdf-43c4-878a-45558c029e27,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08aca6e2-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG os_vif [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:62:9e,bridge_name='br-int',has_traffic_filtering=True,id=08aca6e2-fbdf-43c4-878a-45558c029e27,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08aca6e2-fb') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08aca6e2-fb, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08aca6e2-fb, col_values=(('external_ids', {'iface-id': '08aca6e2-fbdf-43c4-878a-45558c029e27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:62:9e', 'vm-uuid': 'fe769254-aa7a-4038-abb6-18628dbcd227'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:48 user nova-compute[72019]: INFO os_vif [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:62:9e,bridge_name='br-int',has_traffic_filtering=True,id=08aca6e2-fbdf-43c4-878a-45558c029e27,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08aca6e2-fb')
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No VIF found with MAC fa:16:3e:5b:62:9e, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-125b9ce9-a4df-4e77-9c9c-5fe54b104db7 req-1540aa7a-6fcc-4514-b53e-dc5e36befe82 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updated VIF entry in instance network info cache for port 08aca6e2-fbdf-43c4-878a-45558c029e27. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-125b9ce9-a4df-4e77-9c9c-5fe54b104db7 req-1540aa7a-6fcc-4514-b53e-dc5e36befe82 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updating instance_info_cache with network_info: [{"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:31:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-125b9ce9-a4df-4e77-9c9c-5fe54b104db7 req-1540aa7a-6fcc-4514-b53e-dc5e36befe82 service nova] Releasing lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:31:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-fcdd24a9-922c-4262-a6cd-f8b6a84b0f2f req-bbd06c39-df7b-4f9f-845a-04b2286d7e72 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Received event network-vif-plugged-08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:31:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fcdd24a9-922c-4262-a6cd-f8b6a84b0f2f req-bbd06c39-df7b-4f9f-845a-04b2286d7e72 service nova] Acquiring lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fcdd24a9-922c-4262-a6cd-f8b6a84b0f2f req-bbd06c39-df7b-4f9f-845a-04b2286d7e72 service nova] Lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fcdd24a9-922c-4262-a6cd-f8b6a84b0f2f req-bbd06c39-df7b-4f9f-845a-04b2286d7e72 service nova] Lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-fcdd24a9-922c-4262-a6cd-f8b6a84b0f2f req-bbd06c39-df7b-4f9f-845a-04b2286d7e72 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] No waiting events found dispatching network-vif-plugged-08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:31:49 user nova-compute[72019]: WARNING nova.compute.manager [req-fcdd24a9-922c-4262-a6cd-f8b6a84b0f2f req-bbd06c39-df7b-4f9f-845a-04b2286d7e72 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Received unexpected event network-vif-plugged-08aca6e2-fbdf-43c4-878a-45558c029e27 for instance with vm_state building and task_state spawning.
Apr 14 13:31:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-6d793e64-4857-4460-9aa8-238287e505d3 req-9c1d4810-65fa-4be1-ad2c-1a64bbcb0fdd service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Received event network-changed-e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-6d793e64-4857-4460-9aa8-238287e505d3 req-9c1d4810-65fa-4be1-ad2c-1a64bbcb0fdd service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Refreshing instance network info cache due to event network-changed-e5381c33-8ca2-44a1-92a9-adda19cd90a5. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6d793e64-4857-4460-9aa8-238287e505d3 req-9c1d4810-65fa-4be1-ad2c-1a64bbcb0fdd service nova] Acquiring lock "refresh_cache-3c0f7d33-ba0c-4111-857d-319c5788106f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6d793e64-4857-4460-9aa8-238287e505d3 req-9c1d4810-65fa-4be1-ad2c-1a64bbcb0fdd service nova] Acquired lock "refresh_cache-3c0f7d33-ba0c-4111-857d-319c5788106f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG nova.network.neutron [req-6d793e64-4857-4460-9aa8-238287e505d3 req-9c1d4810-65fa-4be1-ad2c-1a64bbcb0fdd service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Refreshing network info cache for port e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "3c0f7d33-ba0c-4111-857d-319c5788106f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG nova.objects.instance [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lazy-loading 'flavor' on Instance uuid 3c0f7d33-ba0c-4111-857d-319c5788106f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "3c0f7d33-ba0c-4111-857d-319c5788106f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:50 user nova-compute[72019]: INFO nova.compute.manager [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Attaching volume afdd0b4a-209d-47cf-b0c3-6a63b2a16772 to /dev/vdb
Apr 14 13:31:50 user nova-compute[72019]: DEBUG os_brick.utils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b18eca3-5b4f-49ad-9010-cfba5f8cd882]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33ecf17-ef5f-4102-9dba-b96a2e0f668b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[92587c6d-8b44-4e0d-b0e5-747d423398d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c5fe69-20f4-4424-a902-2a0bf82b45fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:31:50 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:31:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[970c8d3a-25fe-4521-809d-857893ea4bf7]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG os_brick.utils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:31:50 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Updating existing volume attachment record: 18e3e749-a567-4920-ae6e-310b3d8dfdb3 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.network.neutron [req-6d793e64-4857-4460-9aa8-238287e505d3 req-9c1d4810-65fa-4be1-ad2c-1a64bbcb0fdd service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Updated VIF entry in instance network info cache for port e5381c33-8ca2-44a1-92a9-adda19cd90a5. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.network.neutron [req-6d793e64-4857-4460-9aa8-238287e505d3 req-9c1d4810-65fa-4be1-ad2c-1a64bbcb0fdd service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Updating instance_info_cache with network_info: [{"id": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "address": "fa:16:3e:e9:76:a4", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5381c33-8c", "ovs_interfaceid": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6d793e64-4857-4460-9aa8-238287e505d3 req-9c1d4810-65fa-4be1-ad2c-1a64bbcb0fdd service nova] Releasing lock "refresh_cache-3c0f7d33-ba0c-4111-857d-319c5788106f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479111.7876956, fe769254-aa7a-4038-abb6-18628dbcd227 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:31:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] VM Resumed (Lifecycle Event)
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:31:51 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Instance spawned successfully.
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:31:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479111.7885177, fe769254-aa7a-4038-abb6-18628dbcd227 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:31:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] VM Started (Lifecycle Event)
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-06200677-8324-44d5-8ae5-9d5f29ff8af8 req-8bc54505-c194-4872-830e-5e8f280b7caa service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Received event network-vif-plugged-08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-06200677-8324-44d5-8ae5-9d5f29ff8af8 req-8bc54505-c194-4872-830e-5e8f280b7caa service nova] Acquiring lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-06200677-8324-44d5-8ae5-9d5f29ff8af8 req-8bc54505-c194-4872-830e-5e8f280b7caa service nova] Lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-06200677-8324-44d5-8ae5-9d5f29ff8af8 req-8bc54505-c194-4872-830e-5e8f280b7caa service nova] Lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-06200677-8324-44d5-8ae5-9d5f29ff8af8 req-8bc54505-c194-4872-830e-5e8f280b7caa service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] No waiting events found dispatching network-vif-plugged-08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:31:51 user nova-compute[72019]: WARNING nova.compute.manager [req-06200677-8324-44d5-8ae5-9d5f29ff8af8 req-8bc54505-c194-4872-830e-5e8f280b7caa service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Received unexpected event network-vif-plugged-08aca6e2-fbdf-43c4-878a-45558c029e27 for instance with vm_state building and task_state spawning.
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:31:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:31:51 user nova-compute[72019]: INFO nova.compute.manager [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Took 5.69 seconds to spawn the instance on the hypervisor.
Apr 14 13:31:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:31:51 user nova-compute[72019]: INFO nova.compute.manager [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Took 6.45 seconds to build instance.
Apr 14 13:31:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "fe769254-aa7a-4038-abb6-18628dbcd227" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.540s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479100.421321, 167e06f3-4a3d-418d-8aaa-4827c749258d => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:31:55 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] VM Stopped (Lifecycle Event)
Apr 14 13:31:55 user nova-compute[72019]: DEBUG nova.compute.manager [None req-20c8745b-6da0-464c-9171-78432857a2de None None] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsWRACpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:31:55 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:31:55 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:31:55 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cee85a5-be15-4296-81d1-7a329ab22c20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:31:55 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1463f3e-de09-46d7-a37a-dbb2804ac4af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772] added
Apr 14 13:31:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8894bf8b-3795-4038-b012-d8a65d642d02]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f885d9de-aef9-493e-b17c-7ab039695154]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsWRACpn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsWRACpn" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e14d8-352a-4f47-b1eb-933207387059]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QsWRACpn'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd4e60f-399b-4dee-9973-f996c0c51efa]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a3bcce-4f1c-4036-9293-2a4a1ce9e509]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:31:55 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:31:55 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:31:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:31:55 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:31:55 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:31:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cf5027-bc48-4f98-bce0-2cc6fdac5c4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772, portal: 172.16.0.220,3260]
Apr 14 13:31:55 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772, portal: 172.16.0.220,3260] successful.
Apr 14 13:31:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ac5754-077a-4821-aa56-04d086598121]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efbec27-e3d3-4abe-86d6-906d1930b455]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:31:55 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:31:55 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:31:55 user nova-compute[72019]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 (non-flash)
Apr 14 13:31:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:31:55 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:31:55 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:31:55 user nova-compute[72019]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 (non-flash)
Apr 14 13:31:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c4a928-40ac-4f47-9710-699a175009dc]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:31:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsWRACpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:31:56 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:31:56 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23735613764656235', 'path': '/dev/sdb'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:31:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735613764656235', 'path': '/dev/sdb'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:31:56 user nova-compute[72019]: DEBUG nova.objects.instance [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lazy-loading 'flavor' on Instance uuid 3c0f7d33-ba0c-4111-857d-319c5788106f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:31:56 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:31:56 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:31:56 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:31:56 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:31:56 user nova-compute[72019]:   <serial>afdd0b4a-209d-47cf-b0c3-6a63b2a16772</serial>
Apr 14 13:31:56 user nova-compute[72019]: </disk>
Apr 14 13:31:56 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:31:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:31:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:31:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] No VIF found with MAC fa:16:3e:e9:76:a4, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:31:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.772s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:31:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:31:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "3c0f7d33-ba0c-4111-857d-319c5788106f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:31:58 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:31:58 user nova-compute[72019]: INFO nova.compute.manager [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Detaching volume afdd0b4a-209d-47cf-b0c3-6a63b2a16772
Apr 14 13:31:58 user nova-compute[72019]: INFO nova.virt.block_device [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Attempting to driver detach volume afdd0b4a-209d-47cf-b0c3-6a63b2a16772 from mountpoint /dev/vdb
Apr 14 13:31:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Attempting to detach device vdb from instance 3c0f7d33-ba0c-4111-857d-319c5788106f from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:31:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:31:58 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:31:58 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:31:58 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:31:58 user nova-compute[72019]:   <serial>afdd0b4a-209d-47cf-b0c3-6a63b2a16772</serial>
Apr 14 13:31:58 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:31:58 user nova-compute[72019]: </disk>
Apr 14 13:31:58 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:31:58 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Successfully detached device vdb from instance 3c0f7d33-ba0c-4111-857d-319c5788106f from the persistent domain config.
Apr 14 13:31:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c0f7d33-ba0c-4111-857d-319c5788106f from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:31:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:31:58 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:31:58 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:31:58 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:31:58 user nova-compute[72019]:   <serial>afdd0b4a-209d-47cf-b0c3-6a63b2a16772</serial>
Apr 14 13:31:58 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:31:58 user nova-compute[72019]: </disk>
Apr 14 13:31:58 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681479119.3318725, 3c0f7d33-ba0c-4111-857d-319c5788106f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c0f7d33-ba0c-4111-857d-319c5788106f {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:31:59 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Successfully detached device vdb from instance 3c0f7d33-ba0c-4111-857d-319c5788106f from the live domain config.
Apr 14 13:31:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsWRACpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:31:59 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff88183-f43d-4042-b1c7-4f40e7534c08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:31:59 user nova-compute[72019]: No targets found.
Apr 14 13:31:59 user nova-compute[72019]: iSNS:
Apr 14 13:31:59 user nova-compute[72019]: No targets found.
Apr 14 13:31:59 user nova-compute[72019]: STATIC:
Apr 14 13:31:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272
Apr 14 13:31:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:31:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:31:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d
Apr 14 13:31:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:31:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:31:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:31:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:31:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:31:59 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772
Apr 14 13:31:59 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:31:59 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:31:59 user nova-compute[72019]: FIRMWARE:
Apr 14 13:31:59 user nova-compute[72019]: No targets found.
Apr 14 13:31:59 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:31:59 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:31:59 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4a812a-33e7-49fc-97c7-d07e179b4cb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[856c4ad5-ce2e-45ca-a19b-fd09c891d1c5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:31:59 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:31:59 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:31:59 user nova-compute[72019]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 (non-flash)
Apr 14 13:31:59 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:31:59 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:31:59 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:31:59 user nova-compute[72019]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 (non-flash)
Apr 14 13:31:59 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74646a3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772'): ({'sdb'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Removing single pathed devices sdb {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c72ac64-b90e-49f1-81e7-1e8ff4320bb1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[29982cbc-3472-4925-95ba-5824ebbec526]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Flushing IO for device /dev/sdb {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[db57c499-3297-4884-a0a4-2b9262e435b4]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5196ef34-27ee-437a-91dd-952ff5e341a2]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f809ca-013a-43e1-a788-08846374074c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --logout" returned: 0 in 0.196s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[112ad60d-7058-4346-947c-46f6206be26f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772, portal: 172.16.0.220,3260]
Apr 14 13:31:59 user nova-compute[72019]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772, portal: 172.16.0.220,3260] successful.
Apr 14 13:31:59 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdd0b4a-209d-47cf-b0c3-6a63b2a16772 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff4b8e2-7148-4e2a-976d-5c44f3ed1362]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.484s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] <== disconnect_volume: return (485ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:31:59 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:32:00 user nova-compute[72019]: DEBUG nova.objects.instance [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lazy-loading 'flavor' on Instance uuid 3c0f7d33-ba0c-4111-857d-319c5788106f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:32:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.945s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:02 user nova-compute[72019]: INFO nova.compute.manager [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Unrescuing
Apr 14 13:32:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "refresh_cache-626abaa0-3f53-42cc-978e-21f0a80232fa" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:32:02 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquired lock "refresh_cache-626abaa0-3f53-42cc-978e-21f0a80232fa" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:32:02 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:32:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:03 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Updating instance_info_cache with network_info: [{"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:32:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Releasing lock "refresh_cache-626abaa0-3f53-42cc-978e-21f0a80232fa" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:32:03 user nova-compute[72019]: DEBUG nova.objects.instance [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'flavor' on Instance uuid 626abaa0-3f53-42cc-978e-21f0a80232fa {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:32:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:03 user nova-compute[72019]: DEBUG nova.compute.manager [req-45547d14-eec4-46b1-921c-0df9b98b65f1 req-764e03e4-39ba-4c2c-8559-2ed48cea5e7b service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-vif-unplugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-45547d14-eec4-46b1-921c-0df9b98b65f1 req-764e03e4-39ba-4c2c-8559-2ed48cea5e7b service nova] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-45547d14-eec4-46b1-921c-0df9b98b65f1 req-764e03e4-39ba-4c2c-8559-2ed48cea5e7b service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:03 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-45547d14-eec4-46b1-921c-0df9b98b65f1 req-764e03e4-39ba-4c2c-8559-2ed48cea5e7b service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:03 user nova-compute[72019]: DEBUG nova.compute.manager [req-45547d14-eec4-46b1-921c-0df9b98b65f1 req-764e03e4-39ba-4c2c-8559-2ed48cea5e7b service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] No waiting events found dispatching network-vif-unplugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:32:03 user nova-compute[72019]: WARNING nova.compute.manager [req-45547d14-eec4-46b1-921c-0df9b98b65f1 req-764e03e4-39ba-4c2c-8559-2ed48cea5e7b service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received unexpected event network-vif-unplugged-7d5d9e2b-b502-494a-ac52-70930eda92ac for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:32:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:04 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Instance destroyed successfully.
Apr 14 13:32:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-8feb2677-7061-4d19-8412-4e33f9be8fd2 req-6efc006b-145f-44d4-9c2f-3da878ff9131 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8feb2677-7061-4d19-8412-4e33f9be8fd2 req-6efc006b-145f-44d4-9c2f-3da878ff9131 service nova] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8feb2677-7061-4d19-8412-4e33f9be8fd2 req-6efc006b-145f-44d4-9c2f-3da878ff9131 service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8feb2677-7061-4d19-8412-4e33f9be8fd2 req-6efc006b-145f-44d4-9c2f-3da878ff9131 service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:05 user nova-compute[72019]: DEBUG nova.compute.manager [req-8feb2677-7061-4d19-8412-4e33f9be8fd2 req-6efc006b-145f-44d4-9c2f-3da878ff9131 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] No waiting events found dispatching network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:32:05 user nova-compute[72019]: WARNING nova.compute.manager [req-8feb2677-7061-4d19-8412-4e33f9be8fd2 req-6efc006b-145f-44d4-9c2f-3da878ff9131 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received unexpected event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:32:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:06 user nova-compute[72019]: INFO nova.compute.manager [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Unshelving
Apr 14 13:32:06 user nova-compute[72019]: INFO nova.virt.block_device [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Booting with volume 2724b817-0ad1-4678-9429-3f4e67a0f590 at /dev/vda
Apr 14 13:32:06 user nova-compute[72019]: DEBUG os_brick.utils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f2dbeb-0554-453d-9951-9ac4a278ff08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d27f58-67c4-45c8-922f-906e76ebf00b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[209e0c39-f77f-4e63-8f13-0530f5e0cf3e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[710eee74-210f-4970-a74c-0cca9439adef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:32:06 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:32:06 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d30d5-22e4-4f9d-8f07-8c73880689fb]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG os_brick.utils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:32:06 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updating existing volume attachment record: 8c4a4646-dc0a-4e48-b4d0-c13d286b6f45 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:32:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] No waiting events found dispatching network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:32:07 user nova-compute[72019]: WARNING nova.compute.manager [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received unexpected event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:32:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:07 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:07 user nova-compute[72019]: DEBUG nova.compute.manager [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] No waiting events found dispatching network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:32:07 user nova-compute[72019]: WARNING nova.compute.manager [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received unexpected event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac for instance with vm_state rescued and task_state unrescuing.
Apr 14 13:32:07 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for 626abaa0-3f53-42cc-978e-21f0a80232fa due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:32:07 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479127.712485, 626abaa0-3f53-42cc-978e-21f0a80232fa => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:32:07 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] VM Resumed (Lifecycle Event)
Apr 14 13:32:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:32:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:32:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:32:07 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 13:32:07 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479127.718718, 626abaa0-3f53-42cc-978e-21f0a80232fa => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:32:07 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] VM Started (Lifecycle Event)
Apr 14 13:32:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:32:07 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:32:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:13 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:13 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lazy-loading 'pci_requests' on Instance uuid 04cf64b3-e51b-418f-94f6-7597c4cd74bb {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:32:13 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lazy-loading 'numa_topology' on Instance uuid 04cf64b3-e51b-418f-94f6-7597c4cd74bb {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:32:13 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:32:13 user nova-compute[72019]: INFO nova.compute.claims [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Claim successful on node user
Apr 14 13:32:14 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:32:14 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:32:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:14 user nova-compute[72019]: INFO nova.network.neutron [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updating port 2a3ecee8-e3fc-433e-81d5-f0c9decfd248 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 13:32:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:32:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquired lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:32:14 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:32:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-4badb53f-8202-49b1-b8a8-a8093a8a42ac req-a404da49-69b6-4745-9ba3-ccd684a8f1dc service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-changed-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-4badb53f-8202-49b1-b8a8-a8093a8a42ac req-a404da49-69b6-4745-9ba3-ccd684a8f1dc service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Refreshing instance network info cache due to event network-changed-2a3ecee8-e3fc-433e-81d5-f0c9decfd248. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:32:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4badb53f-8202-49b1-b8a8-a8093a8a42ac req-a404da49-69b6-4745-9ba3-ccd684a8f1dc service nova] Acquiring lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.network.neutron [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updating instance_info_cache with network_info: [{"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Releasing lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:32:15 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Creating image(s)
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Ensure instance console log exists: /opt/stack/data/nova/instances/04cf64b3-e51b-418f-94f6-7597c4cd74bb/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Start _get_guest_xml network_info=[{"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '8c4a4646-dc0a-4e48-b4d0-c13d286b6f45', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAkcHOeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04cf64b3-e51b-418f-94f6-7597c4cd74bb', 'attached_at': '', 'detached_at': '', 'volume_id': '2724b817-0ad1-4678-9429-3f4e67a0f590', 'serial': '2724b817-0ad1-4678-9429-3f4e67a0f590'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4badb53f-8202-49b1-b8a8-a8093a8a42ac req-a404da49-69b6-4745-9ba3-ccd684a8f1dc service nova] Acquired lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.network.neutron [req-4badb53f-8202-49b1-b8a8-a8093a8a42ac req-a404da49-69b6-4745-9ba3-ccd684a8f1dc service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Refreshing network info cache for port 2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:32:15 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:32:15 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lazy-loading 'vcpu_model' on Instance uuid 04cf64b3-e51b-418f-94f6-7597c4cd74bb {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAkcHOeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:32:15 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:32:15 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:32:15 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a503434-541e-48d8-a605-47bc694ed1ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:32:15 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c448df8c-58fe-4344-a529-da65d9ce049a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590] added
Apr 14 13:32:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0950f19a-a3b5-413f-a0f2-78576b9740e8]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc2aa78-d76c-4ab3-afb5-7dfff18b917d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fAkcHOeP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fAkcHOeP" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[93122759-1dc1-4c59-bd33-47af94a18efd]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fAkcHOeP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[13845efc-3bbc-4678-8ece-749fe5f16e17]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09ff4fb-8c0f-47fb-a7b6-442ba11317f7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:32:15 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:32:15 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:32:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:32:15 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:32:15 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:32:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4dcb19-51b9-4055-bd87-265ab765f515]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260]
Apr 14 13:32:15 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260] successful.
Apr 14 13:32:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7416fe3c-b9c2-48a1-ba02-3616a493e0a4]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d097d8b-36e2-4b92-a8fc-9af519ec4d46]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:32:15 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:32:15 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:32:15 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:32:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:32:15 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:32:15 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:32:15 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:32:15 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc11bd5-ce03-4358-bef6-4b66e86be97f]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAkcHOeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.network.neutron [req-4badb53f-8202-49b1-b8a8-a8093a8a42ac req-a404da49-69b6-4745-9ba3-ccd684a8f1dc service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updated VIF entry in instance network info cache for port 2a3ecee8-e3fc-433e-81d5-f0c9decfd248. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG nova.network.neutron [req-4badb53f-8202-49b1-b8a8-a8093a8a42ac req-a404da49-69b6-4745-9ba3-ccd684a8f1dc service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updating instance_info_cache with network_info: [{"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:32:15 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4badb53f-8202-49b1-b8a8-a8093a8a42ac req-a404da49-69b6-4745-9ba3-ccd684a8f1dc service nova] Releasing lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26363663430613230', 'path': '/dev/sdb'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363663430613230', 'path': '/dev/sdb'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-548766851',display_name='tempest-TestShelveInstance-server-548766851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-548766851',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1155531040',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:28:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6ba9f3b2ecb541aba4516734fdebd316',ramdisk_id='',reservation_id='r-6bf35sr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-615050191',owner_user_name='tempest-TestShelveInstance-615050191-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:32:06Z,user_data=None,user_id='01b25b886ade4e6ea689010d655d99a0',uuid=04cf64b3-e51b-418f-94f6-7597c4cd74bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Converting VIF {"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c4:3d,bridge_name='br-int',has_traffic_filtering=True,id=2a3ecee8-e3fc-433e-81d5-f0c9decfd248,network=Network(0a7d4ddd-e535-4d06-a605-a34d3ef8188c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3ecee8-e3') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG nova.objects.instance [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lazy-loading 'pci_devices' on Instance uuid 04cf64b3-e51b-418f-94f6-7597c4cd74bb {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:32:16 user nova-compute[72019]:   <uuid>04cf64b3-e51b-418f-94f6-7597c4cd74bb</uuid>
Apr 14 13:32:16 user nova-compute[72019]:   <name>instance-00000028</name>
Apr 14 13:32:16 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:32:16 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:32:16 user nova-compute[72019]:   <metadata>
Apr 14 13:32:16 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:32:16 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:32:16 user nova-compute[72019]:       <nova:name>tempest-TestShelveInstance-server-548766851</nova:name>
Apr 14 13:32:16 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:32:15</nova:creationTime>
Apr 14 13:32:16 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:32:16 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:32:16 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:32:16 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:32:16 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:32:16 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:32:16 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:32:16 user nova-compute[72019]:       <nova:owner>
Apr 14 13:32:16 user nova-compute[72019]:         <nova:user uuid="01b25b886ade4e6ea689010d655d99a0">tempest-TestShelveInstance-615050191-project-member</nova:user>
Apr 14 13:32:16 user nova-compute[72019]:         <nova:project uuid="6ba9f3b2ecb541aba4516734fdebd316">tempest-TestShelveInstance-615050191</nova:project>
Apr 14 13:32:16 user nova-compute[72019]:       </nova:owner>
Apr 14 13:32:16 user nova-compute[72019]:       <nova:ports>
Apr 14 13:32:16 user nova-compute[72019]:         <nova:port uuid="2a3ecee8-e3fc-433e-81d5-f0c9decfd248">
Apr 14 13:32:16 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 13:32:16 user nova-compute[72019]:         </nova:port>
Apr 14 13:32:16 user nova-compute[72019]:       </nova:ports>
Apr 14 13:32:16 user nova-compute[72019]:     </nova:instance>
Apr 14 13:32:16 user nova-compute[72019]:   </metadata>
Apr 14 13:32:16 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:32:16 user nova-compute[72019]:     <system>
Apr 14 13:32:16 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:32:16 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:32:16 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:32:16 user nova-compute[72019]:       <entry name="serial">04cf64b3-e51b-418f-94f6-7597c4cd74bb</entry>
Apr 14 13:32:16 user nova-compute[72019]:       <entry name="uuid">04cf64b3-e51b-418f-94f6-7597c4cd74bb</entry>
Apr 14 13:32:16 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:32:16 user nova-compute[72019]:     </system>
Apr 14 13:32:16 user nova-compute[72019]:   </sysinfo>
Apr 14 13:32:16 user nova-compute[72019]:   <os>
Apr 14 13:32:16 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:32:16 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:32:16 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:32:16 user nova-compute[72019]:   </os>
Apr 14 13:32:16 user nova-compute[72019]:   <features>
Apr 14 13:32:16 user nova-compute[72019]:     <acpi/>
Apr 14 13:32:16 user nova-compute[72019]:     <apic/>
Apr 14 13:32:16 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:32:16 user nova-compute[72019]:   </features>
Apr 14 13:32:16 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:32:16 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:32:16 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:32:16 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:32:16 user nova-compute[72019]:   </clock>
Apr 14 13:32:16 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:32:16 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:32:16 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:32:16 user nova-compute[72019]:   </cpu>
Apr 14 13:32:16 user nova-compute[72019]:   <devices>
Apr 14 13:32:16 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:32:16 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:32:16 user nova-compute[72019]:       <source dev="/dev/sdb"/>
Apr 14 13:32:16 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:32:16 user nova-compute[72019]:       <serial>2724b817-0ad1-4678-9429-3f4e67a0f590</serial>
Apr 14 13:32:16 user nova-compute[72019]:     </disk>
Apr 14 13:32:16 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:32:16 user nova-compute[72019]:       <mac address="fa:16:3e:ad:c4:3d"/>
Apr 14 13:32:16 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:32:16 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:32:16 user nova-compute[72019]:       <target dev="tap2a3ecee8-e3"/>
Apr 14 13:32:16 user nova-compute[72019]:     </interface>
Apr 14 13:32:16 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:32:16 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/04cf64b3-e51b-418f-94f6-7597c4cd74bb/console.log" append="off"/>
Apr 14 13:32:16 user nova-compute[72019]:     </serial>
Apr 14 13:32:16 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:32:16 user nova-compute[72019]:     <video>
Apr 14 13:32:16 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:32:16 user nova-compute[72019]:     </video>
Apr 14 13:32:16 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:32:16 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:32:16 user nova-compute[72019]:     </rng>
Apr 14 13:32:16 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:32:16 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:32:16 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:32:16 user nova-compute[72019]:     </memballoon>
Apr 14 13:32:16 user nova-compute[72019]:   </devices>
Apr 14 13:32:16 user nova-compute[72019]: </domain>
Apr 14 13:32:16 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-548766851',display_name='tempest-TestShelveInstance-server-548766851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-548766851',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1155531040',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:28:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6ba9f3b2ecb541aba4516734fdebd316',ramdisk_id='',reservation_id='r-6bf35sr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-615050191',owner_user_name='tempest-TestShelveInstance-615050191-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:32:06Z,user_data=None,user_id='01b25b886ade4e6ea689010d655d99a0',uuid=04cf64b3-e51b-418f-94f6-7597c4cd74bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Converting VIF {"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c4:3d,bridge_name='br-int',has_traffic_filtering=True,id=2a3ecee8-e3fc-433e-81d5-f0c9decfd248,network=Network(0a7d4ddd-e535-4d06-a605-a34d3ef8188c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3ecee8-e3') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG os_vif [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c4:3d,bridge_name='br-int',has_traffic_filtering=True,id=2a3ecee8-e3fc-433e-81d5-f0c9decfd248,network=Network(0a7d4ddd-e535-4d06-a605-a34d3ef8188c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3ecee8-e3') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a3ecee8-e3, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a3ecee8-e3, col_values=(('external_ids', {'iface-id': '2a3ecee8-e3fc-433e-81d5-f0c9decfd248', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:c4:3d', 'vm-uuid': '04cf64b3-e51b-418f-94f6-7597c4cd74bb'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:32:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:16 user nova-compute[72019]: INFO os_vif [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c4:3d,bridge_name='br-int',has_traffic_filtering=True,id=2a3ecee8-e3fc-433e-81d5-f0c9decfd248,network=Network(0a7d4ddd-e535-4d06-a605-a34d3ef8188c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3ecee8-e3')
Apr 14 13:32:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:32:17 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] No VIF found with MAC fa:16:3e:ad:c4:3d, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:32:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-c4ad34b3-3379-4f4e-97a0-c9d160028cac req-9869c0e9-79d4-438f-90f1-1948461b873e service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-changed-40073711-7679-449b-8856-60989099101c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-c4ad34b3-3379-4f4e-97a0-c9d160028cac req-9869c0e9-79d4-438f-90f1-1948461b873e service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Refreshing instance network info cache due to event network-changed-40073711-7679-449b-8856-60989099101c. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:32:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c4ad34b3-3379-4f4e-97a0-c9d160028cac req-9869c0e9-79d4-438f-90f1-1948461b873e service nova] Acquiring lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:32:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c4ad34b3-3379-4f4e-97a0-c9d160028cac req-9869c0e9-79d4-438f-90f1-1948461b873e service nova] Acquired lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:32:17 user nova-compute[72019]: DEBUG nova.network.neutron [req-c4ad34b3-3379-4f4e-97a0-c9d160028cac req-9869c0e9-79d4-438f-90f1-1948461b873e service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Refreshing network info cache for port 40073711-7679-449b-8856-60989099101c {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:32:17 user nova-compute[72019]: DEBUG nova.network.neutron [req-c4ad34b3-3379-4f4e-97a0-c9d160028cac req-9869c0e9-79d4-438f-90f1-1948461b873e service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Updated VIF entry in instance network info cache for port 40073711-7679-449b-8856-60989099101c. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:32:17 user nova-compute[72019]: DEBUG nova.network.neutron [req-c4ad34b3-3379-4f4e-97a0-c9d160028cac req-9869c0e9-79d4-438f-90f1-1948461b873e service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Updating instance_info_cache with network_info: [{"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:32:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-c4ad34b3-3379-4f4e-97a0-c9d160028cac req-9869c0e9-79d4-438f-90f1-1948461b873e service nova] Releasing lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:18 user nova-compute[72019]: INFO nova.compute.manager [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Detaching volume 3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d
Apr 14 13:32:18 user nova-compute[72019]: INFO nova.virt.block_device [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Attempting to driver detach volume 3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d from mountpoint /dev/vdb
Apr 14 13:32:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Attempting to detach device vdb from instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:32:18 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:32:18 user nova-compute[72019]:   <source dev="/dev/sdg"/>
Apr 14 13:32:18 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:32:18 user nova-compute[72019]:   <serial>3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d</serial>
Apr 14 13:32:18 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:32:18 user nova-compute[72019]: </disk>
Apr 14 13:32:18 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-0e4629f5-6a10-4f8c-bd2f-8ef621f81073 req-3ebc4626-607f-4d57-9d4c-92e6e0b98b93 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0e4629f5-6a10-4f8c-bd2f-8ef621f81073 req-3ebc4626-607f-4d57-9d4c-92e6e0b98b93 service nova] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0e4629f5-6a10-4f8c-bd2f-8ef621f81073 req-3ebc4626-607f-4d57-9d4c-92e6e0b98b93 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0e4629f5-6a10-4f8c-bd2f-8ef621f81073 req-3ebc4626-607f-4d57-9d4c-92e6e0b98b93 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-0e4629f5-6a10-4f8c-bd2f-8ef621f81073 req-3ebc4626-607f-4d57-9d4c-92e6e0b98b93 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] No waiting events found dispatching network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:32:18 user nova-compute[72019]: WARNING nova.compute.manager [req-0e4629f5-6a10-4f8c-bd2f-8ef621f81073 req-3ebc4626-607f-4d57-9d4c-92e6e0b98b93 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received unexpected event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 13:32:18 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Successfully detached device vdb from instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 from the persistent domain config.
Apr 14 13:32:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:32:18 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:32:18 user nova-compute[72019]:   <source dev="/dev/sdg"/>
Apr 14 13:32:18 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:32:18 user nova-compute[72019]:   <serial>3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d</serial>
Apr 14 13:32:18 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:32:18 user nova-compute[72019]: </disk>
Apr 14 13:32:18 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681479139.0911412, 9970f98b-ade9-4d08-a88d-b11a222adcf9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:32:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Successfully detached device vdb from instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 from the live domain config.
Apr 14 13:32:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhjgHKFR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:32:19 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdb694e-64c8-4580-978f-a70d912d85e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:32:19 user nova-compute[72019]: No targets found.
Apr 14 13:32:19 user nova-compute[72019]: iSNS:
Apr 14 13:32:19 user nova-compute[72019]: No targets found.
Apr 14 13:32:19 user nova-compute[72019]: STATIC:
Apr 14 13:32:19 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272
Apr 14 13:32:19 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:32:19 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:32:19 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d
Apr 14 13:32:19 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:32:19 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:32:19 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:32:19 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:32:19 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:32:19 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590
Apr 14 13:32:19 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:32:19 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:32:19 user nova-compute[72019]: FIRMWARE:
Apr 14 13:32:19 user nova-compute[72019]: No targets found.
Apr 14 13:32:19 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:32:19 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:32:19 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32b346d-be8f-4737-ad62-f0d8f0edf9d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef627d26-87ea-481d-9e3c-baa07cebc61c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:32:19 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:32:19 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:32:19 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:32:19 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:32:19 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:32:19 user nova-compute[72019]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d (non-flash)
Apr 14 13:32:19 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:32:19 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74646a3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d'): ({'sdg'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Removing single pathed devices sdg {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2763f8f1-b478-455b-baf2-329c9039f938]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[25888b00-4f32-486c-bd97-91e5c30d5f44]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Flushing IO for device /dev/sdg {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b808ae9-d1ba-46cb-9192-a25067a14051]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bbc66d-b1fe-457b-a694-1e390dd14d1e]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] SCSI volumes sdg have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd20f22-64a1-48c2-b23c-963d5d106caf]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ab6f2e-ffc5-4681-97d5-e85ed6b784cf]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d, portal: 172.16.0.220,3260]
Apr 14 13:32:19 user nova-compute[72019]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d, portal: 172.16.0.220,3260] successful.
Apr 14 13:32:19 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cf0581-3e6c-4908-a54e-4918c91f14a5]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] <== disconnect_volume: return (317ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-87065d21-fb3d-42aa-8ebb-8c1204913e54 req-6c032093-67ed-485e-9278-d1d2579f3fb9 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-changed-40073711-7679-449b-8856-60989099101c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG nova.compute.manager [req-87065d21-fb3d-42aa-8ebb-8c1204913e54 req-6c032093-67ed-485e-9278-d1d2579f3fb9 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Refreshing instance network info cache due to event network-changed-40073711-7679-449b-8856-60989099101c. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-87065d21-fb3d-42aa-8ebb-8c1204913e54 req-6c032093-67ed-485e-9278-d1d2579f3fb9 service nova] Acquiring lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-87065d21-fb3d-42aa-8ebb-8c1204913e54 req-6c032093-67ed-485e-9278-d1d2579f3fb9 service nova] Acquired lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG nova.network.neutron [req-87065d21-fb3d-42aa-8ebb-8c1204913e54 req-6c032093-67ed-485e-9278-d1d2579f3fb9 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Refreshing network info cache for port 40073711-7679-449b-8856-60989099101c {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG nova.network.neutron [req-87065d21-fb3d-42aa-8ebb-8c1204913e54 req-6c032093-67ed-485e-9278-d1d2579f3fb9 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Updated VIF entry in instance network info cache for port 40073711-7679-449b-8856-60989099101c. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG nova.network.neutron [req-87065d21-fb3d-42aa-8ebb-8c1204913e54 req-6c032093-67ed-485e-9278-d1d2579f3fb9 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Updating instance_info_cache with network_info: [{"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:32:19 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-87065d21-fb3d-42aa-8ebb-8c1204913e54 req-6c032093-67ed-485e-9278-d1d2579f3fb9 service nova] Releasing lock "refresh_cache-9970f98b-ade9-4d08-a88d-b11a222adcf9" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:32:20 user nova-compute[72019]: DEBUG nova.objects.instance [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'flavor' on Instance uuid 9970f98b-ade9-4d08-a88d-b11a222adcf9 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:32:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.865s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:20 user nova-compute[72019]: DEBUG nova.compute.manager [req-70eb8e32-765a-4595-843f-440b32a135ea req-020c6358-0864-46b1-8a48-6050d40d0214 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-70eb8e32-765a-4595-843f-440b32a135ea req-020c6358-0864-46b1-8a48-6050d40d0214 service nova] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-70eb8e32-765a-4595-843f-440b32a135ea req-020c6358-0864-46b1-8a48-6050d40d0214 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-70eb8e32-765a-4595-843f-440b32a135ea req-020c6358-0864-46b1-8a48-6050d40d0214 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:20 user nova-compute[72019]: DEBUG nova.compute.manager [req-70eb8e32-765a-4595-843f-440b32a135ea req-020c6358-0864-46b1-8a48-6050d40d0214 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] No waiting events found dispatching network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:32:20 user nova-compute[72019]: WARNING nova.compute.manager [req-70eb8e32-765a-4595-843f-440b32a135ea req-020c6358-0864-46b1-8a48-6050d40d0214 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received unexpected event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 13:32:20 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479140.8687825, 04cf64b3-e51b-418f-94f6-7597c4cd74bb => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:32:20 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] VM Resumed (Lifecycle Event)
Apr 14 13:32:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:32:20 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:32:20 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Instance spawned successfully.
Apr 14 13:32:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:32:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:32:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:32:20 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:32:20 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479140.8700233, 04cf64b3-e51b-418f-94f6-7597c4cd74bb => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:32:20 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] VM Started (Lifecycle Event)
Apr 14 13:32:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.541s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:32:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:32:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:22 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:32:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:29 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:32:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:32:31 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:32:31 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:32:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "5f323dce-be29-4437-8992-4bfec3ba29ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "5f323dce-be29-4437-8992-4bfec3ba29ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:31 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:32:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:31 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:32:31 user nova-compute[72019]: INFO nova.compute.claims [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Claim successful on node user
Apr 14 13:32:32 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:32:32 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:32:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:32:32 user nova-compute[72019]: INFO nova.virt.block_device [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Booting with volume 9056cb37-c575-40f0-9cc7-7cd88b944cd4 at /dev/vda
Apr 14 13:32:32 user nova-compute[72019]: DEBUG nova.policy [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG os_brick.utils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[17678ef0-a05c-4eda-a5c3-72beab369902]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[285e7e57-652d-4c14-b725-351560ffe454]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[96599ed0-1333-48f4-b029-1f5291d7ef31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71e2258-4e6c-4de2-9fb2-81bec387b277]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:32:32 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:32:32 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5efc0a-7788-4cb5-b81d-4bf4b968bf04]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG os_brick.utils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:32:32 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Updating existing volume attachment record: 673e2209-5a4b-47e9-bf1c-74f72131b07c {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:32:33 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Successfully created port: a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:32:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:32:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:32:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-911be82f-bcf1-4b02-a218-ab977b28afe1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:32:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-911be82f-bcf1-4b02-a218-ab977b28afe1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:32:33 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:32:34 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Updating instance_info_cache with network_info: [{"id": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "address": "fa:16:3e:bb:f3:4c", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c3bad4-02", "ovs_interfaceid": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:32:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-911be82f-bcf1-4b02-a218-ab977b28afe1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:32:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:32:34 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Successfully updated port: a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:32:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "refresh_cache-5f323dce-be29-4437-8992-4bfec3ba29ab" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:32:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquired lock "refresh_cache-5f323dce-be29-4437-8992-4bfec3ba29ab" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:32:34 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:32:34 user nova-compute[72019]: DEBUG nova.compute.manager [req-8f8b6b1d-91bb-49b6-84fe-323d237a9638 req-fa0ce9c8-fb0b-41ac-aa3a-fb4ec919ade6 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Received event network-changed-a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:34 user nova-compute[72019]: DEBUG nova.compute.manager [req-8f8b6b1d-91bb-49b6-84fe-323d237a9638 req-fa0ce9c8-fb0b-41ac-aa3a-fb4ec919ade6 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Refreshing instance network info cache due to event network-changed-a23e9593-5778-4287-890a-07585622bc27. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:32:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8f8b6b1d-91bb-49b6-84fe-323d237a9638 req-fa0ce9c8-fb0b-41ac-aa3a-fb4ec919ade6 service nova] Acquiring lock "refresh_cache-5f323dce-be29-4437-8992-4bfec3ba29ab" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:32:34 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:32:35 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Updating instance_info_cache with network_info: [{"id": "a23e9593-5778-4287-890a-07585622bc27", "address": "fa:16:3e:c5:57:b3", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e9593-57", "ovs_interfaceid": "a23e9593-5778-4287-890a-07585622bc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:32:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Releasing lock "refresh_cache-5f323dce-be29-4437-8992-4bfec3ba29ab" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:32:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Instance network_info: |[{"id": "a23e9593-5778-4287-890a-07585622bc27", "address": "fa:16:3e:c5:57:b3", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e9593-57", "ovs_interfaceid": "a23e9593-5778-4287-890a-07585622bc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:32:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8f8b6b1d-91bb-49b6-84fe-323d237a9638 req-fa0ce9c8-fb0b-41ac-aa3a-fb4ec919ade6 service nova] Acquired lock "refresh_cache-5f323dce-be29-4437-8992-4bfec3ba29ab" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:32:35 user nova-compute[72019]: DEBUG nova.network.neutron [req-8f8b6b1d-91bb-49b6-84fe-323d237a9638 req-fa0ce9c8-fb0b-41ac-aa3a-fb4ec919ade6 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Refreshing network info cache for port a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:32:35 user nova-compute[72019]: DEBUG nova.network.neutron [req-8f8b6b1d-91bb-49b6-84fe-323d237a9638 req-fa0ce9c8-fb0b-41ac-aa3a-fb4ec919ade6 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Updated VIF entry in instance network info cache for port a23e9593-5778-4287-890a-07585622bc27. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:32:35 user nova-compute[72019]: DEBUG nova.network.neutron [req-8f8b6b1d-91bb-49b6-84fe-323d237a9638 req-fa0ce9c8-fb0b-41ac-aa3a-fb4ec919ade6 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Updating instance_info_cache with network_info: [{"id": "a23e9593-5778-4287-890a-07585622bc27", "address": "fa:16:3e:c5:57:b3", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e9593-57", "ovs_interfaceid": "a23e9593-5778-4287-890a-07585622bc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:32:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8f8b6b1d-91bb-49b6-84fe-323d237a9638 req-fa0ce9c8-fb0b-41ac-aa3a-fb4ec919ade6 service nova] Releasing lock "refresh_cache-5f323dce-be29-4437-8992-4bfec3ba29ab" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:32:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:32:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:32:36 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:32:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:32:38 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Creating image(s)
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Ensure instance console log exists: /opt/stack/data/nova/instances/5f323dce-be29-4437-8992-4bfec3ba29ab/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Start _get_guest_xml network_info=[{"id": "a23e9593-5778-4287-890a-07585622bc27", "address": "fa:16:3e:c5:57:b3", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e9593-57", "ovs_interfaceid": "a23e9593-5778-4287-890a-07585622bc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '673e2209-5a4b-47e9-bf1c-74f72131b07c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnhPHgQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5f323dce-be29-4437-8992-4bfec3ba29ab', 'attached_at': '', 'detached_at': '', 'volume_id': '9056cb37-c575-40f0-9cc7-7cd88b944cd4', 'serial': '9056cb37-c575-40f0-9cc7-7cd88b944cd4'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:32:38 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:32:38 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnhPHgQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:32:38 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:32:38 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:32:38 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a0cb1a-3fde-4249-8b77-c6ddce7c81ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:32:38 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ac353a-5e28-4af5-bc06-8ccf045807c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4] added
Apr 14 13:32:38 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d54479-bcdf-4ec6-bdf5-262643dea0d6]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[88983705-00a2-43ab-9179-336bb3f2ac7c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnhPHgQf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnhPHgQf" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df5a057-f600-4513-9130-dc8f87fbdbf1]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jnhPHgQf'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a679b47a-87a0-476e-80e1-a2afbf8a55be]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c590b32-f992-44c7-b7ca-3341387f2705]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:32:38 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:32:38 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:32:38 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:32:38 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:32:38 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:32:38 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e385bc59-37a2-46c2-9354-361ba3ef0a60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260]
Apr 14 13:32:38 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260] successful.
Apr 14 13:32:38 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[039077b3-9f9e-43f4-96a0-749940e4477e]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[322ef23e-d1ec-4a93-8024-c307e56d39d9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:32:38 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:32:38 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:32:38 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:32:38 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:32:38 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:32:38 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:32:38 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:32:38 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6188044f-fb6c-4e34-80a8-1404afeac746]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnhPHgQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26533633233616334', 'path': '/dev/sdd'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533633233616334', 'path': '/dev/sdd'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1586008634',display_name='tempest-TestVolumeBootPattern-server-1586008634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1586008634',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn0p0IUuVWoQy0dGsU9Pfuky6ks2ZRYQtS2s2AMQUPgWS/ZFj3/9xG//6C/vHeESCtbDFovyBlscNk5g1knYdZi4/iSS7XffFRPqq5TMnScynxdTnC9z463yGcQBrDWEQ==',key_name='tempest-TestVolumeBootPattern-212867192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-h91zctcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:32:33Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=5f323dce-be29-4437-8992-4bfec3ba29ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a23e9593-5778-4287-890a-07585622bc27", "address": "fa:16:3e:c5:57:b3", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e9593-57", "ovs_interfaceid": "a23e9593-5778-4287-890a-07585622bc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "a23e9593-5778-4287-890a-07585622bc27", "address": "fa:16:3e:c5:57:b3", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e9593-57", "ovs_interfaceid": "a23e9593-5778-4287-890a-07585622bc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:57:b3,bridge_name='br-int',has_traffic_filtering=True,id=a23e9593-5778-4287-890a-07585622bc27,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e9593-57') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG nova.objects.instance [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f323dce-be29-4437-8992-4bfec3ba29ab {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:32:39 user nova-compute[72019]:   <uuid>5f323dce-be29-4437-8992-4bfec3ba29ab</uuid>
Apr 14 13:32:39 user nova-compute[72019]:   <name>instance-0000002d</name>
Apr 14 13:32:39 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:32:39 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:32:39 user nova-compute[72019]:   <metadata>
Apr 14 13:32:39 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:32:39 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:32:39 user nova-compute[72019]:       <nova:name>tempest-TestVolumeBootPattern-server-1586008634</nova:name>
Apr 14 13:32:39 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:32:38</nova:creationTime>
Apr 14 13:32:39 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:32:39 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:32:39 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:32:39 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:32:39 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:32:39 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:32:39 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:32:39 user nova-compute[72019]:       <nova:owner>
Apr 14 13:32:39 user nova-compute[72019]:         <nova:user uuid="bb40413bd0c3490d97b997f69c930f72">tempest-TestVolumeBootPattern-1645546988-project-member</nova:user>
Apr 14 13:32:39 user nova-compute[72019]:         <nova:project uuid="818de6fa330c4c87a3b6228345d9f13a">tempest-TestVolumeBootPattern-1645546988</nova:project>
Apr 14 13:32:39 user nova-compute[72019]:       </nova:owner>
Apr 14 13:32:39 user nova-compute[72019]:       <nova:ports>
Apr 14 13:32:39 user nova-compute[72019]:         <nova:port uuid="a23e9593-5778-4287-890a-07585622bc27">
Apr 14 13:32:39 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 13:32:39 user nova-compute[72019]:         </nova:port>
Apr 14 13:32:39 user nova-compute[72019]:       </nova:ports>
Apr 14 13:32:39 user nova-compute[72019]:     </nova:instance>
Apr 14 13:32:39 user nova-compute[72019]:   </metadata>
Apr 14 13:32:39 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:32:39 user nova-compute[72019]:     <system>
Apr 14 13:32:39 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:32:39 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:32:39 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:32:39 user nova-compute[72019]:       <entry name="serial">5f323dce-be29-4437-8992-4bfec3ba29ab</entry>
Apr 14 13:32:39 user nova-compute[72019]:       <entry name="uuid">5f323dce-be29-4437-8992-4bfec3ba29ab</entry>
Apr 14 13:32:39 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:32:39 user nova-compute[72019]:     </system>
Apr 14 13:32:39 user nova-compute[72019]:   </sysinfo>
Apr 14 13:32:39 user nova-compute[72019]:   <os>
Apr 14 13:32:39 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:32:39 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:32:39 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:32:39 user nova-compute[72019]:   </os>
Apr 14 13:32:39 user nova-compute[72019]:   <features>
Apr 14 13:32:39 user nova-compute[72019]:     <acpi/>
Apr 14 13:32:39 user nova-compute[72019]:     <apic/>
Apr 14 13:32:39 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:32:39 user nova-compute[72019]:   </features>
Apr 14 13:32:39 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:32:39 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:32:39 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:32:39 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:32:39 user nova-compute[72019]:   </clock>
Apr 14 13:32:39 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:32:39 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:32:39 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:32:39 user nova-compute[72019]:   </cpu>
Apr 14 13:32:39 user nova-compute[72019]:   <devices>
Apr 14 13:32:39 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:32:39 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:32:39 user nova-compute[72019]:       <source dev="/dev/sdd"/>
Apr 14 13:32:39 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:32:39 user nova-compute[72019]:       <serial>9056cb37-c575-40f0-9cc7-7cd88b944cd4</serial>
Apr 14 13:32:39 user nova-compute[72019]:     </disk>
Apr 14 13:32:39 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:32:39 user nova-compute[72019]:       <mac address="fa:16:3e:c5:57:b3"/>
Apr 14 13:32:39 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:32:39 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:32:39 user nova-compute[72019]:       <target dev="tapa23e9593-57"/>
Apr 14 13:32:39 user nova-compute[72019]:     </interface>
Apr 14 13:32:39 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:32:39 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/5f323dce-be29-4437-8992-4bfec3ba29ab/console.log" append="off"/>
Apr 14 13:32:39 user nova-compute[72019]:     </serial>
Apr 14 13:32:39 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:32:39 user nova-compute[72019]:     <video>
Apr 14 13:32:39 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:32:39 user nova-compute[72019]:     </video>
Apr 14 13:32:39 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:32:39 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:32:39 user nova-compute[72019]:     </rng>
Apr 14 13:32:39 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:32:39 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:32:39 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:32:39 user nova-compute[72019]:     </memballoon>
Apr 14 13:32:39 user nova-compute[72019]:   </devices>
Apr 14 13:32:39 user nova-compute[72019]: </domain>
Apr 14 13:32:39 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1586008634',display_name='tempest-TestVolumeBootPattern-server-1586008634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1586008634',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn0p0IUuVWoQy0dGsU9Pfuky6ks2ZRYQtS2s2AMQUPgWS/ZFj3/9xG//6C/vHeESCtbDFovyBlscNk5g1knYdZi4/iSS7XffFRPqq5TMnScynxdTnC9z463yGcQBrDWEQ==',key_name='tempest-TestVolumeBootPattern-212867192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-h91zctcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:32:33Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=5f323dce-be29-4437-8992-4bfec3ba29ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a23e9593-5778-4287-890a-07585622bc27", "address": "fa:16:3e:c5:57:b3", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e9593-57", "ovs_interfaceid": "a23e9593-5778-4287-890a-07585622bc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "a23e9593-5778-4287-890a-07585622bc27", "address": "fa:16:3e:c5:57:b3", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e9593-57", "ovs_interfaceid": "a23e9593-5778-4287-890a-07585622bc27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:57:b3,bridge_name='br-int',has_traffic_filtering=True,id=a23e9593-5778-4287-890a-07585622bc27,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e9593-57') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG os_vif [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:57:b3,bridge_name='br-int',has_traffic_filtering=True,id=a23e9593-5778-4287-890a-07585622bc27,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e9593-57') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa23e9593-57, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa23e9593-57, col_values=(('external_ids', {'iface-id': 'a23e9593-5778-4287-890a-07585622bc27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:57:b3', 'vm-uuid': '5f323dce-be29-4437-8992-4bfec3ba29ab'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:39 user nova-compute[72019]: INFO os_vif [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:57:b3,bridge_name='br-int',has_traffic_filtering=True,id=a23e9593-5778-4287-890a-07585622bc27,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e9593-57')
Apr 14 13:32:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] No VIF found with MAC fa:16:3e:c5:57:b3, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479162.9371345, 5f323dce-be29-4437-8992-4bfec3ba29ab => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:32:43 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] VM Resumed (Lifecycle Event)
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-5e9b748b-b036-4bae-898c-f3343169a353 req-383b5ebd-d84a-4884-9217-0ad7b7957fb8 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Received event network-vif-plugged-a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5e9b748b-b036-4bae-898c-f3343169a353 req-383b5ebd-d84a-4884-9217-0ad7b7957fb8 service nova] Acquiring lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5e9b748b-b036-4bae-898c-f3343169a353 req-383b5ebd-d84a-4884-9217-0ad7b7957fb8 service nova] Lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5e9b748b-b036-4bae-898c-f3343169a353 req-383b5ebd-d84a-4884-9217-0ad7b7957fb8 service nova] Lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-5e9b748b-b036-4bae-898c-f3343169a353 req-383b5ebd-d84a-4884-9217-0ad7b7957fb8 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] No waiting events found dispatching network-vif-plugged-a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:32:43 user nova-compute[72019]: WARNING nova.compute.manager [req-5e9b748b-b036-4bae-898c-f3343169a353 req-383b5ebd-d84a-4884-9217-0ad7b7957fb8 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Received unexpected event network-vif-plugged-a23e9593-5778-4287-890a-07585622bc27 for instance with vm_state building and task_state spawning.
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-aafdde75-b5b9-4a98-9d64-eed8d1aea356 req-b4d215e6-e600-47ed-a9bb-5f8afa0f47bc service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Received event network-vif-plugged-a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aafdde75-b5b9-4a98-9d64-eed8d1aea356 req-b4d215e6-e600-47ed-a9bb-5f8afa0f47bc service nova] Acquiring lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aafdde75-b5b9-4a98-9d64-eed8d1aea356 req-b4d215e6-e600-47ed-a9bb-5f8afa0f47bc service nova] Lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-aafdde75-b5b9-4a98-9d64-eed8d1aea356 req-b4d215e6-e600-47ed-a9bb-5f8afa0f47bc service nova] Lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.manager [req-aafdde75-b5b9-4a98-9d64-eed8d1aea356 req-b4d215e6-e600-47ed-a9bb-5f8afa0f47bc service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] No waiting events found dispatching network-vif-plugged-a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:32:43 user nova-compute[72019]: WARNING nova.compute.manager [req-aafdde75-b5b9-4a98-9d64-eed8d1aea356 req-b4d215e6-e600-47ed-a9bb-5f8afa0f47bc service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Received unexpected event network-vif-plugged-a23e9593-5778-4287-890a-07585622bc27 for instance with vm_state building and task_state spawning.
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:32:43 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:32:43 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7644MB free_disk=25.824462890625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:43 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Instance spawned successfully.
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:32:43 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479162.938029, 5f323dce-be29-4437-8992-4bfec3ba29ab => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:32:43 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] VM Started (Lifecycle Event)
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:32:43 user nova-compute[72019]: INFO nova.compute.manager [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Took 5.21 seconds to spawn the instance on the hypervisor.
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:32:43 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 626abaa0-3f53-42cc-978e-21f0a80232fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 3c0f7d33-ba0c-4111-857d-319c5788106f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 03b76423-23ff-4721-8300-b198286c109a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance fe769254-aa7a-4038-abb6-18628dbcd227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 5f323dce-be29-4437-8992-4bfec3ba29ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:32:43 user nova-compute[72019]: INFO nova.compute.manager [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Took 11.44 seconds to build instance.
Apr 14 13:32:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "5f323dce-be29-4437-8992-4bfec3ba29ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.559s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:32:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:44 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:32:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-53ce726d-1d7a-460c-be9d-5030fc5ef93d req-733eaedd-c500-44e3-b0c0-662093b9a6b6 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Received event network-changed-e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-53ce726d-1d7a-460c-be9d-5030fc5ef93d req-733eaedd-c500-44e3-b0c0-662093b9a6b6 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Refreshing instance network info cache due to event network-changed-e5381c33-8ca2-44a1-92a9-adda19cd90a5. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:32:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-53ce726d-1d7a-460c-be9d-5030fc5ef93d req-733eaedd-c500-44e3-b0c0-662093b9a6b6 service nova] Acquiring lock "refresh_cache-3c0f7d33-ba0c-4111-857d-319c5788106f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:32:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-53ce726d-1d7a-460c-be9d-5030fc5ef93d req-733eaedd-c500-44e3-b0c0-662093b9a6b6 service nova] Acquired lock "refresh_cache-3c0f7d33-ba0c-4111-857d-319c5788106f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:32:49 user nova-compute[72019]: DEBUG nova.network.neutron [req-53ce726d-1d7a-460c-be9d-5030fc5ef93d req-733eaedd-c500-44e3-b0c0-662093b9a6b6 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Refreshing network info cache for port e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:32:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "3c0f7d33-ba0c-4111-857d-319c5788106f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:49 user nova-compute[72019]: INFO nova.compute.manager [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Terminating instance
Apr 14 13:32:49 user nova-compute[72019]: DEBUG nova.compute.manager [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:32:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-bde46aef-21cf-49c8-bbaa-ba0fd9cd8bde req-0d432ad2-c03a-46f3-9a92-e399fb3cda37 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Received event network-vif-unplugged-e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-bde46aef-21cf-49c8-bbaa-ba0fd9cd8bde req-0d432ad2-c03a-46f3-9a92-e399fb3cda37 service nova] Acquiring lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-bde46aef-21cf-49c8-bbaa-ba0fd9cd8bde req-0d432ad2-c03a-46f3-9a92-e399fb3cda37 service nova] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-bde46aef-21cf-49c8-bbaa-ba0fd9cd8bde req-0d432ad2-c03a-46f3-9a92-e399fb3cda37 service nova] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-bde46aef-21cf-49c8-bbaa-ba0fd9cd8bde req-0d432ad2-c03a-46f3-9a92-e399fb3cda37 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] No waiting events found dispatching network-vif-unplugged-e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-bde46aef-21cf-49c8-bbaa-ba0fd9cd8bde req-0d432ad2-c03a-46f3-9a92-e399fb3cda37 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Received event network-vif-unplugged-e5381c33-8ca2-44a1-92a9-adda19cd90a5 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG nova.network.neutron [req-53ce726d-1d7a-460c-be9d-5030fc5ef93d req-733eaedd-c500-44e3-b0c0-662093b9a6b6 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Updated VIF entry in instance network info cache for port e5381c33-8ca2-44a1-92a9-adda19cd90a5. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG nova.network.neutron [req-53ce726d-1d7a-460c-be9d-5030fc5ef93d req-733eaedd-c500-44e3-b0c0-662093b9a6b6 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Updating instance_info_cache with network_info: [{"id": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "address": "fa:16:3e:e9:76:a4", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5381c33-8c", "ovs_interfaceid": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-53ce726d-1d7a-460c-be9d-5030fc5ef93d req-733eaedd-c500-44e3-b0c0-662093b9a6b6 service nova] Releasing lock "refresh_cache-3c0f7d33-ba0c-4111-857d-319c5788106f" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:32:50 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Instance destroyed successfully.
Apr 14 13:32:50 user nova-compute[72019]: DEBUG nova.objects.instance [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lazy-loading 'resources' on Instance uuid 3c0f7d33-ba0c-4111-857d-319c5788106f {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-846458075',display_name='tempest-TestStampPattern-server-846458075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-846458075',id=42,image_ref='fdaeaeaf-d612-4b58-80b5-8cf70c8002c5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIm4aARBA4lAX/hfwMD4oBZFv2cTXlcgSngjcTEDIv9RAHTvjbNkAIIQYYwrK0JxNUWLzReMonMtMkMBWIgzI882038PhtWRli7iqrN9dwPmOnFtL9wStfKPVLf4sjHM0w==',key_name='tempest-TestStampPattern-924006334',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:30:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdd6e06c2dbf479697403fee2b1b72e2',ramdisk_id='',reservation_id='r-1mmr2d69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='31781f5a-460a-41e3-bdcf-9cb20f050ba3',image_min_disk='1',image_min_ram='0',image_owner_id='fdd6e06c2dbf479697403fee2b1b72e2',image_owner_project_name='tempest-TestStampPattern-1896841208',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1896841208-project-member',image_user_id='d53a298063a346ec9b41110051e689c8',owner_project_name='tempest-TestStampPattern-1896841208',owner_user_name='tempest-TestStampPattern-1896841208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:30:05Z,user_data=None,user_id='d53a298063a346ec9b41110051e689c8',uuid=3c0f7d33-ba0c-4111-857d-319c5788106f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "address": "fa:16:3e:e9:76:a4", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5381c33-8c", "ovs_interfaceid": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Converting VIF {"id": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "address": "fa:16:3e:e9:76:a4", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5381c33-8c", "ovs_interfaceid": "e5381c33-8ca2-44a1-92a9-adda19cd90a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:76:a4,bridge_name='br-int',has_traffic_filtering=True,id=e5381c33-8ca2-44a1-92a9-adda19cd90a5,network=Network(09bf32cb-4684-4c95-a44c-6924d228b6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5381c33-8c') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG os_vif [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:76:a4,bridge_name='br-int',has_traffic_filtering=True,id=e5381c33-8ca2-44a1-92a9-adda19cd90a5,network=Network(09bf32cb-4684-4c95-a44c-6924d228b6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5381c33-8c') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5381c33-8c, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:50 user nova-compute[72019]: INFO os_vif [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:76:a4,bridge_name='br-int',has_traffic_filtering=True,id=e5381c33-8ca2-44a1-92a9-adda19cd90a5,network=Network(09bf32cb-4684-4c95-a44c-6924d228b6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5381c33-8c')
Apr 14 13:32:50 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Deleting instance files /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f_del
Apr 14 13:32:50 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Deletion of /opt/stack/data/nova/instances/3c0f7d33-ba0c-4111-857d-319c5788106f_del complete
Apr 14 13:32:51 user nova-compute[72019]: INFO nova.compute.manager [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Took 1.44 seconds to destroy the instance on the hypervisor.
Apr 14 13:32:51 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:32:51 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:32:51 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:32:51 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:32:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-aef4a545-a868-4657-abdf-6a1862aaf726 req-84d70d74-febc-4aa1-b29c-ce3a47670715 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Received event network-vif-deleted-e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:51 user nova-compute[72019]: INFO nova.compute.manager [req-aef4a545-a868-4657-abdf-6a1862aaf726 req-84d70d74-febc-4aa1-b29c-ce3a47670715 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Neutron deleted interface e5381c33-8ca2-44a1-92a9-adda19cd90a5; detaching it from the instance and deleting it from the info cache
Apr 14 13:32:51 user nova-compute[72019]: DEBUG nova.network.neutron [req-aef4a545-a868-4657-abdf-6a1862aaf726 req-84d70d74-febc-4aa1-b29c-ce3a47670715 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:32:51 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Took 0.56 seconds to deallocate network for instance.
Apr 14 13:32:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-aef4a545-a868-4657-abdf-6a1862aaf726 req-84d70d74-febc-4aa1-b29c-ce3a47670715 service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Detach interface failed, port_id=e5381c33-8ca2-44a1-92a9-adda19cd90a5, reason: Instance 3c0f7d33-ba0c-4111-857d-319c5788106f could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:32:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:52 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:32:52 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:32:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:52 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Deleted allocations for instance 3c0f7d33-ba0c-4111-857d-319c5788106f
Apr 14 13:32:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.590s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:52 user nova-compute[72019]: DEBUG nova.compute.manager [req-0f46e177-5280-4e44-8e33-7006d051d884 req-a3b7d832-349b-466e-9515-2fa9d1eed0ac service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Received event network-vif-plugged-e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:32:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0f46e177-5280-4e44-8e33-7006d051d884 req-a3b7d832-349b-466e-9515-2fa9d1eed0ac service nova] Acquiring lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:32:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0f46e177-5280-4e44-8e33-7006d051d884 req-a3b7d832-349b-466e-9515-2fa9d1eed0ac service nova] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:32:52 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0f46e177-5280-4e44-8e33-7006d051d884 req-a3b7d832-349b-466e-9515-2fa9d1eed0ac service nova] Lock "3c0f7d33-ba0c-4111-857d-319c5788106f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:32:52 user nova-compute[72019]: DEBUG nova.compute.manager [req-0f46e177-5280-4e44-8e33-7006d051d884 req-a3b7d832-349b-466e-9515-2fa9d1eed0ac service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] No waiting events found dispatching network-vif-plugged-e5381c33-8ca2-44a1-92a9-adda19cd90a5 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:32:52 user nova-compute[72019]: WARNING nova.compute.manager [req-0f46e177-5280-4e44-8e33-7006d051d884 req-a3b7d832-349b-466e-9515-2fa9d1eed0ac service nova] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Received unexpected event network-vif-plugged-e5381c33-8ca2-44a1-92a9-adda19cd90a5 for instance with vm_state deleted and task_state None.
Apr 14 13:32:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:32:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:05 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479170.9234633, 3c0f7d33-ba0c-4111-857d-319c5788106f => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:33:05 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] VM Stopped (Lifecycle Event)
Apr 14 13:33:05 user nova-compute[72019]: DEBUG nova.compute.manager [None req-9fc601c7-9a55-4209-a90b-81356b730ad4 None None] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:33:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:12 user nova-compute[72019]: INFO nova.compute.manager [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Terminating instance
Apr 14 13:33:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-44c51a1a-0d51-4ea9-812f-c3499c9751c9 req-35f9ca96-1f29-44fd-90e2-4ecaa2f43e2b service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-vif-unplugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-44c51a1a-0d51-4ea9-812f-c3499c9751c9 req-35f9ca96-1f29-44fd-90e2-4ecaa2f43e2b service nova] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-44c51a1a-0d51-4ea9-812f-c3499c9751c9 req-35f9ca96-1f29-44fd-90e2-4ecaa2f43e2b service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-44c51a1a-0d51-4ea9-812f-c3499c9751c9 req-35f9ca96-1f29-44fd-90e2-4ecaa2f43e2b service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-44c51a1a-0d51-4ea9-812f-c3499c9751c9 req-35f9ca96-1f29-44fd-90e2-4ecaa2f43e2b service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] No waiting events found dispatching network-vif-unplugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG nova.compute.manager [req-44c51a1a-0d51-4ea9-812f-c3499c9751c9 req-35f9ca96-1f29-44fd-90e2-4ecaa2f43e2b service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-vif-unplugged-40073711-7679-449b-8856-60989099101c for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:33:12 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Instance destroyed successfully.
Apr 14 13:33:12 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'resources' on Instance uuid 9970f98b-ade9-4d08-a88d-b11a222adcf9 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1063896944',display_name='tempest-TestMinimumBasicScenario-server-1063896944',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1063896944',id=38,image_ref='8ce99b3b-1304-4e73-a97b-e88d2addf3cd',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlGI9D4/7pv9vQ3CZXSBbrtbkDj0yyrDe0vnPovM9eQS+33AyfYa6U/m76AkDp7hpito5RK9q+cvN4dfCRtTK05lrs3oeIET8QKJZApVgXOoADHebmvp9epkF8YKFm31Q==',key_name='tempest-TestMinimumBasicScenario-1166797782',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:28:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae2e95243bc4e19b093629197fbb173',ramdisk_id='',reservation_id='r-sm5kx50s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8ce99b3b-1304-4e73-a97b-e88d2addf3cd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-929002235',owner_user_name='tempest-TestMinimumBasicScenario-929002235-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:30:33Z,user_data=None,user_id='9e1f366e5f9d43b9bbd8be316ddaa3a9',uuid=9970f98b-ade9-4d08-a88d-b11a222adcf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converting VIF {"id": "40073711-7679-449b-8856-60989099101c", "address": "fa:16:3e:79:31:bf", "network": {"id": "b9f90019-51fc-4e13-aa38-910e26bbb8d1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1965140651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae2e95243bc4e19b093629197fbb173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40073711-76", "ovs_interfaceid": "40073711-7679-449b-8856-60989099101c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:31:bf,bridge_name='br-int',has_traffic_filtering=True,id=40073711-7679-449b-8856-60989099101c,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40073711-76') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG os_vif [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:31:bf,bridge_name='br-int',has_traffic_filtering=True,id=40073711-7679-449b-8856-60989099101c,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40073711-76') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40073711-76, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:33:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:12 user nova-compute[72019]: INFO os_vif [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:31:bf,bridge_name='br-int',has_traffic_filtering=True,id=40073711-7679-449b-8856-60989099101c,network=Network(b9f90019-51fc-4e13-aa38-910e26bbb8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40073711-76')
Apr 14 13:33:12 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Deleting instance files /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9_del
Apr 14 13:33:12 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Deletion of /opt/stack/data/nova/instances/9970f98b-ade9-4d08-a88d-b11a222adcf9_del complete
Apr 14 13:33:13 user nova-compute[72019]: INFO nova.compute.manager [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 13:33:13 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:33:13 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:33:13 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:33:13 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:33:13 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Took 0.67 seconds to deallocate network for instance.
Apr 14 13:33:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:13 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:13 user nova-compute[72019]: DEBUG nova.compute.manager [req-d3bb8c5a-4358-465f-bb97-f4c796010daa req-bee17a9d-1fe7-40f0-b031-151c3a760180 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-vif-deleted-40073711-7679-449b-8856-60989099101c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:14 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:33:14 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:33:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:14 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Deleted allocations for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9
Apr 14 13:33:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-9fe7c5ee-775c-40f3-b849-33034df1b5a7 req-df5dae4e-6492-4117-affe-442cbb027734 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received event network-vif-plugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9fe7c5ee-775c-40f3-b849-33034df1b5a7 req-df5dae4e-6492-4117-affe-442cbb027734 service nova] Acquiring lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9fe7c5ee-775c-40f3-b849-33034df1b5a7 req-df5dae4e-6492-4117-affe-442cbb027734 service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:14 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-9fe7c5ee-775c-40f3-b849-33034df1b5a7 req-df5dae4e-6492-4117-affe-442cbb027734 service nova] Lock "9970f98b-ade9-4d08-a88d-b11a222adcf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:14 user nova-compute[72019]: DEBUG nova.compute.manager [req-9fe7c5ee-775c-40f3-b849-33034df1b5a7 req-df5dae4e-6492-4117-affe-442cbb027734 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] No waiting events found dispatching network-vif-plugged-40073711-7679-449b-8856-60989099101c {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:33:14 user nova-compute[72019]: WARNING nova.compute.manager [req-9fe7c5ee-775c-40f3-b849-33034df1b5a7 req-df5dae4e-6492-4117-affe-442cbb027734 service nova] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Received unexpected event network-vif-plugged-40073711-7679-449b-8856-60989099101c for instance with vm_state deleted and task_state None.
Apr 14 13:33:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-7a9ab973-b1f4-4766-afff-49c934db4bcf req-8f4fed91-f50c-44dd-8048-c767e710775b service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Received event network-changed-5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:17 user nova-compute[72019]: DEBUG nova.compute.manager [req-7a9ab973-b1f4-4766-afff-49c934db4bcf req-8f4fed91-f50c-44dd-8048-c767e710775b service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Refreshing instance network info cache due to event network-changed-5670a4df-018a-4b12-bf37-a1fada7bfe9e. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:33:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7a9ab973-b1f4-4766-afff-49c934db4bcf req-8f4fed91-f50c-44dd-8048-c767e710775b service nova] Acquiring lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:33:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7a9ab973-b1f4-4766-afff-49c934db4bcf req-8f4fed91-f50c-44dd-8048-c767e710775b service nova] Acquired lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:33:17 user nova-compute[72019]: DEBUG nova.network.neutron [req-7a9ab973-b1f4-4766-afff-49c934db4bcf req-8f4fed91-f50c-44dd-8048-c767e710775b service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Refreshing network info cache for port 5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:33:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG nova.objects.instance [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'flavor' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:18 user nova-compute[72019]: INFO nova.compute.manager [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Attaching volume 4aa03404-f31f-4d55-b48c-857b42075b60 to /dev/vdb
Apr 14 13:33:18 user nova-compute[72019]: DEBUG os_brick.utils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1351e6-b104-4d95-ab93-fba69ceabc69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4851fbe-5858-49f7-bd95-3e67dcb4ad2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5d1484-c088-4aeb-a14f-862b10e0c0ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[40eb4472-f3e5-47b5-bb6c-bb450e17ebf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:33:18 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7d9e46-3390-47ce-a101-cabfd643b3bb]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG os_brick.utils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Updating existing volume attachment record: ae9c18f0-0ae3-483f-928e-c04500c7d6f4 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG nova.network.neutron [req-7a9ab973-b1f4-4766-afff-49c934db4bcf req-8f4fed91-f50c-44dd-8048-c767e710775b service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Updated VIF entry in instance network info cache for port 5670a4df-018a-4b12-bf37-a1fada7bfe9e. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG nova.network.neutron [req-7a9ab973-b1f4-4766-afff-49c934db4bcf req-8f4fed91-f50c-44dd-8048-c767e710775b service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Updating instance_info_cache with network_info: [{"id": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "address": "fa:16:3e:3e:80:6a", "network": {"id": "a9168d79-fcda-4f76-82db-8993f13bbff3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1548446165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad49f75bbe9461b936963e8dc6c8be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5670a4df-01", "ovs_interfaceid": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:33:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7a9ab973-b1f4-4766-afff-49c934db4bcf req-8f4fed91-f50c-44dd-8048-c767e710775b service nova] Releasing lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuoHCPEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:33:22 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:33:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:33:22 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:33:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:33:22 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:33:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca2dde8-bcbd-4892-b100-5abad79c6892]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:33:22 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[62050227-70a3-47c7-8cdd-025d8e8420c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60] added
Apr 14 13:33:22 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3769f16-6cdd-482c-805d-0a5518b230a4]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d116d99-9ffe-490e-b0c7-6c66ea1d88ce]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:22 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RuoHCPEL {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RuoHCPEL" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e90499-6566-4338-bd07-ac89c565f56e]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RuoHCPEL'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc21f73-00ea-48c8-b8a0-dfb15fbefe82]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d039e5-f19a-49c2-a175-2ed922fe9240]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7c234e-2429-4f38-bc78-7c430c16a506]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60, portal: 172.16.0.220,3260]
Apr 14 13:33:23 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60, portal: 172.16.0.220,3260] successful.
Apr 14 13:33:23 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.047s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e553f562-1415-4824-9309-f9e5a123b832]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b860ec22-a0b5-4846-9ff0-3dda19a4a8bf]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 (non-flash)
Apr 14 13:33:23 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[da172c89-b5b3-4998-9d9b-55890880ada8]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuoHCPEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:33:23 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:33:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:33:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26166636339396363', 'path': '/dev/sde'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:33:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166636339396363', 'path': '/dev/sde'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:33:24 user nova-compute[72019]: DEBUG nova.objects.instance [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'flavor' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:33:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:33:24 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:33:24 user nova-compute[72019]:   <source dev="/dev/sde"/>
Apr 14 13:33:24 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:33:24 user nova-compute[72019]:   <serial>4aa03404-f31f-4d55-b48c-857b42075b60</serial>
Apr 14 13:33:24 user nova-compute[72019]: </disk>
Apr 14 13:33:24 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:33:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:33:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:33:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] No VIF found with MAC fa:16:3e:3e:80:6a, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:33:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.568s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:27 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479192.9322467, 9970f98b-ade9-4d08-a88d-b11a222adcf9 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:33:27 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] VM Stopped (Lifecycle Event)
Apr 14 13:33:27 user nova-compute[72019]: DEBUG nova.compute.manager [None req-d15e2a15-88f3-4617-88ad-b2c07b285400 None None] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:33:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:29 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:33:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:33:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:33:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:34 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:33:34 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:33:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:33:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:33:34 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:33:35 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Updating instance_info_cache with network_info: [{"id": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "address": "fa:16:3e:af:84:dd", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55e9150-07", "ovs_interfaceid": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:33:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:33:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:33:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:33:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:33:36 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:33:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:37 user nova-compute[72019]: INFO nova.compute.manager [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Detaching volume 4aa03404-f31f-4d55-b48c-857b42075b60
Apr 14 13:33:37 user nova-compute[72019]: INFO nova.virt.block_device [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Attempting to driver detach volume 4aa03404-f31f-4d55-b48c-857b42075b60 from mountpoint /dev/vdb
Apr 14 13:33:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Attempting to detach device vdb from instance 03b76423-23ff-4721-8300-b198286c109a from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:33:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:33:37 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:33:37 user nova-compute[72019]:   <source dev="/dev/sde"/>
Apr 14 13:33:37 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:33:37 user nova-compute[72019]:   <serial>4aa03404-f31f-4d55-b48c-857b42075b60</serial>
Apr 14 13:33:37 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:33:37 user nova-compute[72019]: </disk>
Apr 14 13:33:37 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:33:37 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Successfully detached device vdb from instance 03b76423-23ff-4721-8300-b198286c109a from the persistent domain config.
Apr 14 13:33:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03b76423-23ff-4721-8300-b198286c109a from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:33:37 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:33:37 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:33:37 user nova-compute[72019]:   <source dev="/dev/sde"/>
Apr 14 13:33:37 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:33:37 user nova-compute[72019]:   <serial>4aa03404-f31f-4d55-b48c-857b42075b60</serial>
Apr 14 13:33:37 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:33:37 user nova-compute[72019]: </disk>
Apr 14 13:33:37 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:33:37 user nova-compute[72019]: DEBUG nova.compute.manager [req-e03de2bc-62f6-45d8-8f16-88c6e07b6824 req-abe3129a-cbf2-4bd2-b193-ca4113a860c3 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Received event network-changed-08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:37 user nova-compute[72019]: DEBUG nova.compute.manager [req-e03de2bc-62f6-45d8-8f16-88c6e07b6824 req-abe3129a-cbf2-4bd2-b193-ca4113a860c3 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Refreshing instance network info cache due to event network-changed-08aca6e2-fbdf-43c4-878a-45558c029e27. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:33:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e03de2bc-62f6-45d8-8f16-88c6e07b6824 req-abe3129a-cbf2-4bd2-b193-ca4113a860c3 service nova] Acquiring lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:33:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e03de2bc-62f6-45d8-8f16-88c6e07b6824 req-abe3129a-cbf2-4bd2-b193-ca4113a860c3 service nova] Acquired lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:33:37 user nova-compute[72019]: DEBUG nova.network.neutron [req-e03de2bc-62f6-45d8-8f16-88c6e07b6824 req-abe3129a-cbf2-4bd2-b193-ca4113a860c3 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Refreshing network info cache for port 08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:33:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681479218.039382, 03b76423-23ff-4721-8300-b198286c109a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:33:38 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Successfully detached device vdb from instance 03b76423-23ff-4721-8300-b198286c109a from the live domain config.
Apr 14 13:33:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuoHCPEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:33:38 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e66165-5b27-41ba-89db-802c95dcc85b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:33:38 user nova-compute[72019]: No targets found.
Apr 14 13:33:38 user nova-compute[72019]: iSNS:
Apr 14 13:33:38 user nova-compute[72019]: No targets found.
Apr 14 13:33:38 user nova-compute[72019]: STATIC:
Apr 14 13:33:38 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272
Apr 14 13:33:38 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:33:38 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:33:38 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60
Apr 14 13:33:38 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:33:38 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:33:38 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:33:38 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:33:38 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:33:38 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590
Apr 14 13:33:38 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:33:38 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:33:38 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4
Apr 14 13:33:38 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:33:38 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:33:38 user nova-compute[72019]: FIRMWARE:
Apr 14 13:33:38 user nova-compute[72019]: No targets found.
Apr 14 13:33:38 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:33:38 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:33:38 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb40928f-6acf-41f2-ab2d-88f3f2744e71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[11125e72-924f-4e26-8f2f-d7b5c7079302]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:33:38 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:33:38 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:33:38 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:33:38 user nova-compute[72019]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 (non-flash)
Apr 14 13:33:38 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:33:38 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:33:38 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:33:38 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:33:38 user nova-compute[72019]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 (non-flash)
Apr 14 13:33:38 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74918e7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60'): ({'sde'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Removing single pathed devices sde {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e74a90-5395-469b-9fd7-cc46a3aa3981]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4b8809-33de-497d-a4c3-e9d302813f1a]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Flushing IO for device /dev/sde {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68bed09-8c94-47c2-9d0e-64ebeb20f6ae]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[345d99b9-2d01-4e91-a737-6102d638a9ba]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc01ac54-b75b-4cbf-a1f8-9c09914adfb1]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG nova.network.neutron [req-e03de2bc-62f6-45d8-8f16-88c6e07b6824 req-abe3129a-cbf2-4bd2-b193-ca4113a860c3 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updated VIF entry in instance network info cache for port 08aca6e2-fbdf-43c4-878a-45558c029e27. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG nova.network.neutron [req-e03de2bc-62f6-45d8-8f16-88c6e07b6824 req-abe3129a-cbf2-4bd2-b193-ca4113a860c3 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updating instance_info_cache with network_info: [{"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e03de2bc-62f6-45d8-8f16-88c6e07b6824 req-abe3129a-cbf2-4bd2-b193-ca4113a860c3 service nova] Releasing lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffafa08-c4bf-4264-9bdf-d31698ffd61d]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60, portal: 172.16.0.220,3260]
Apr 14 13:33:38 user nova-compute[72019]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60, portal: 172.16.0.220,3260] successful.
Apr 14 13:33:38 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa03404-f31f-4d55-b48c-857b42075b60 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60960be-ecfe-471b-99ce-4ad1d9b0d86b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] <== disconnect_volume: return (321ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'flavor' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.844s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:33:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:33:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:40 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:33:40 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:33:40 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:33:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=7758MB free_disk=25.834842681884766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:33:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 626abaa0-3f53-42cc-978e-21f0a80232fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 03b76423-23ff-4721-8300-b198286c109a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance fe769254-aa7a-4038-abb6-18628dbcd227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 5f323dce-be29-4437-8992-4bfec3ba29ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing inventories for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Updating ProviderTree inventory for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Updating inventory in ProviderTree for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing aggregate associations for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569, aggregates: None {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing trait associations for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:33:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.716s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:42 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:33:42 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:33:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "b64515ec-405b-4d02-9195-3b0efe3b5488" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:33:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:42 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:33:42 user nova-compute[72019]: INFO nova.compute.claims [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Claim successful on node user
Apr 14 13:33:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG nova.network.neutron [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:33:43 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:33:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG nova.policy [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:33:43 user nova-compute[72019]: INFO nova.virt.block_device [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Booting with volume 492fdd47-3fa9-474f-83e3-dfaee2a0c94d at /dev/vda
Apr 14 13:33:43 user nova-compute[72019]: DEBUG os_brick.utils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e8dbb2-9f93-47ac-8f9f-48d7d4cf8ac3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b820efbb-0a55-4443-b6a4-8340eea47a46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cf3876-9125-4d60-b1b5-bc31d9cf7499]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[105f1112-3d0b-495e-98f2-eaa034cd1e2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:33:43 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:33:43 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4091adce-f046-4f73-91c3-4d88f4bf24d0]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG os_brick.utils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:33:43 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updating existing volume attachment record: 2fdb76c5-2b92-4081-938e-116187d9dc5f {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:33:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:44 user nova-compute[72019]: DEBUG nova.network.neutron [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Successfully created port: c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:33:44 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:33:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72019) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG nova.network.neutron [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Successfully updated port: c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquired lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG nova.network.neutron [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG nova.compute.manager [req-d882c6ac-7d82-4108-969f-456854f91ee6 req-b5363fbb-1079-4623-bc2a-40dec04a2201 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received event network-changed-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG nova.compute.manager [req-d882c6ac-7d82-4108-969f-456854f91ee6 req-b5363fbb-1079-4623-bc2a-40dec04a2201 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Refreshing instance network info cache due to event network-changed-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d882c6ac-7d82-4108-969f-456854f91ee6 req-b5363fbb-1079-4623-bc2a-40dec04a2201 service nova] Acquiring lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG nova.network.neutron [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG nova.network.neutron [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updating instance_info_cache with network_info: [{"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Releasing lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG nova.compute.manager [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Instance network_info: |[{"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d882c6ac-7d82-4108-969f-456854f91ee6 req-b5363fbb-1079-4623-bc2a-40dec04a2201 service nova] Acquired lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG nova.network.neutron [req-d882c6ac-7d82-4108-969f-456854f91ee6 req-b5363fbb-1079-4623-bc2a-40dec04a2201 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Refreshing network info cache for port c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG nova.network.neutron [req-d882c6ac-7d82-4108-969f-456854f91ee6 req-b5363fbb-1079-4623-bc2a-40dec04a2201 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updated VIF entry in instance network info cache for port c7944161-7d6c-4fa8-b0b9-a6e2e3c23203. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG nova.network.neutron [req-d882c6ac-7d82-4108-969f-456854f91ee6 req-b5363fbb-1079-4623-bc2a-40dec04a2201 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updating instance_info_cache with network_info: [{"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:33:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d882c6ac-7d82-4108-969f-456854f91ee6 req-b5363fbb-1079-4623-bc2a-40dec04a2201 service nova] Releasing lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-82cf03b0-2267-4dea-85cf-499c0f9b1f43 req-9993d105-96df-49f0-84a9-5c5d7d843c0e service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Received event network-changed-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-82cf03b0-2267-4dea-85cf-499c0f9b1f43 req-9993d105-96df-49f0-84a9-5c5d7d843c0e service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Refreshing instance network info cache due to event network-changed-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-82cf03b0-2267-4dea-85cf-499c0f9b1f43 req-9993d105-96df-49f0-84a9-5c5d7d843c0e service nova] Acquiring lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-82cf03b0-2267-4dea-85cf-499c0f9b1f43 req-9993d105-96df-49f0-84a9-5c5d7d843c0e service nova] Acquired lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG nova.network.neutron [req-82cf03b0-2267-4dea-85cf-499c0f9b1f43 req-9993d105-96df-49f0-84a9-5c5d7d843c0e service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Refreshing network info cache for port c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:47 user nova-compute[72019]: INFO nova.compute.manager [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Terminating instance
Apr 14 13:33:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.compute.manager [req-fed5e1db-121d-4d85-b12c-b32a447ad53b req-0876bd01-b380-4d9e-8561-f543a4120b9c service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Received event network-vif-unplugged-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fed5e1db-121d-4d85-b12c-b32a447ad53b req-0876bd01-b380-4d9e-8561-f543a4120b9c service nova] Acquiring lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fed5e1db-121d-4d85-b12c-b32a447ad53b req-0876bd01-b380-4d9e-8561-f543a4120b9c service nova] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-fed5e1db-121d-4d85-b12c-b32a447ad53b req-0876bd01-b380-4d9e-8561-f543a4120b9c service nova] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.compute.manager [req-fed5e1db-121d-4d85-b12c-b32a447ad53b req-0876bd01-b380-4d9e-8561-f543a4120b9c service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] No waiting events found dispatching network-vif-unplugged-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.compute.manager [req-fed5e1db-121d-4d85-b12c-b32a447ad53b req-0876bd01-b380-4d9e-8561-f543a4120b9c service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Received event network-vif-unplugged-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.compute.manager [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:33:48 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Creating image(s)
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Ensure instance console log exists: /opt/stack/data/nova/instances/b64515ec-405b-4d02-9195-3b0efe3b5488/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Start _get_guest_xml network_info=[{"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '2fdb76c5-2b92-4081-938e-116187d9dc5f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXtobSsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b64515ec-405b-4d02-9195-3b0efe3b5488', 'attached_at': '', 'detached_at': '', 'volume_id': '492fdd47-3fa9-474f-83e3-dfaee2a0c94d', 'serial': '492fdd47-3fa9-474f-83e3-dfaee2a0c94d'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-82cf03b0-2267-4dea-85cf-499c0f9b1f43 req-9993d105-96df-49f0-84a9-5c5d7d843c0e service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Updated VIF entry in instance network info cache for port c55e9150-0706-4fa7-9c0c-e94b7aefc8eb. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.network.neutron [req-82cf03b0-2267-4dea-85cf-499c0f9b1f43 req-9993d105-96df-49f0-84a9-5c5d7d843c0e service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Updating instance_info_cache with network_info: [{"id": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "address": "fa:16:3e:af:84:dd", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55e9150-07", "ovs_interfaceid": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:48 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:33:48 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXtobSsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:33:48 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:33:48 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:33:48 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:33:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-82cf03b0-2267-4dea-85cf-499c0f9b1f43 req-9993d105-96df-49f0-84a9-5c5d7d843c0e service nova] Releasing lock "refresh_cache-31781f5a-460a-41e3-bdcf-9cb20f050ba3" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:48 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Instance destroyed successfully.
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lazy-loading 'resources' on Instance uuid 31781f5a-460a-41e3-bdcf-9cb20f050ba3 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeab2c3f-a32e-44ba-98bb-a5762b24b675]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:33:48 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1255991021',display_name='tempest-TestStampPattern-server-1255991021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1255991021',id=37,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIm4aARBA4lAX/hfwMD4oBZFv2cTXlcgSngjcTEDIv9RAHTvjbNkAIIQYYwrK0JxNUWLzReMonMtMkMBWIgzI882038PhtWRli7iqrN9dwPmOnFtL9wStfKPVLf4sjHM0w==',key_name='tempest-TestStampPattern-924006334',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:26:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdd6e06c2dbf479697403fee2b1b72e2',ramdisk_id='',reservation_id='r-2dmaqv87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1896841208',owner_user_name='tempest-TestStampPattern-1896841208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:29:53Z,user_data=None,user_id='d53a298063a346ec9b41110051e689c8',uuid=31781f5a-460a-41e3-bdcf-9cb20f050ba3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "address": "fa:16:3e:af:84:dd", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55e9150-07", "ovs_interfaceid": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Converting VIF {"id": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "address": "fa:16:3e:af:84:dd", "network": {"id": "09bf32cb-4684-4c95-a44c-6924d228b6f0", "bridge": "br-int", "label": "tempest-TestStampPattern-2011506238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd6e06c2dbf479697403fee2b1b72e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc55e9150-07", "ovs_interfaceid": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:84:dd,bridge_name='br-int',has_traffic_filtering=True,id=c55e9150-0706-4fa7-9c0c-e94b7aefc8eb,network=Network(09bf32cb-4684-4c95-a44c-6924d228b6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc55e9150-07') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_vif [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:84:dd,bridge_name='br-int',has_traffic_filtering=True,id=c55e9150-0706-4fa7-9c0c-e94b7aefc8eb,network=Network(09bf32cb-4684-4c95-a44c-6924d228b6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc55e9150-07') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc55e9150-07, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[037064bb-9813-4c50-a57d-2a62545de9fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d] added
Apr 14 13:33:48 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:48 user nova-compute[72019]: INFO os_vif [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:84:dd,bridge_name='br-int',has_traffic_filtering=True,id=c55e9150-0706-4fa7-9c0c-e94b7aefc8eb,network=Network(09bf32cb-4684-4c95-a44c-6924d228b6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc55e9150-07')
Apr 14 13:33:48 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Deleting instance files /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3_del
Apr 14 13:33:48 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Deletion of /opt/stack/data/nova/instances/31781f5a-460a-41e3-bdcf-9cb20f050ba3_del complete
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[476059ed-ee01-48d5-99a1-1ed0484e97ba]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30cdda4-3505-4b72-a872-8aad3427a70c]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zXtobSsZ {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zXtobSsZ" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5a3e98-d0b9-44fe-862a-471ea946cd4a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zXtobSsZ'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:48 user nova-compute[72019]: INFO nova.compute.manager [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b174de81-7d01-43a2-933b-e32596282093]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc75120f-6c4f-4b13-ba4e-759c736826cd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd8e466-9474-4a71-a2b9-573b51edb500]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260]
Apr 14 13:33:48 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260] successful.
Apr 14 13:33:48 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2079311a-0797-4e56-877d-50cd86bcaf0f]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4021c7-ee9d-4393-aee7-c4a8814430e0]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:33:48 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:33:48 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:33:48 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4752cc05-433e-405b-91fe-c86841153bf4]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:33:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXtobSsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:33:49 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Took 0.55 seconds to deallocate network for instance.
Apr 14 13:33:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:49 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Deleted allocations for instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3
Apr 14 13:33:49 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Cleaning up deleted instances {{(pid=72019) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] There are 0 instances to clean {{(pid=72019) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.996s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26134656436373231', 'path': '/dev/sde'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134656436373231', 'path': '/dev/sde'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-403210657',display_name='tempest-ServerActionsTestJSON-server-403210657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-403210657',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-olbsjqoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:33:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=b64515ec-405b-4d02-9195-3b0efe3b5488,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:17:55,bridge_name='br-int',has_traffic_filtering=True,id=c7944161-7d6c-4fa8-b0b9-a6e2e3c23203,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7944161-7d') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG nova.objects.instance [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'pci_devices' on Instance uuid b64515ec-405b-4d02-9195-3b0efe3b5488 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:33:49 user nova-compute[72019]:   <uuid>b64515ec-405b-4d02-9195-3b0efe3b5488</uuid>
Apr 14 13:33:49 user nova-compute[72019]:   <name>instance-0000002e</name>
Apr 14 13:33:49 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:33:49 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:33:49 user nova-compute[72019]:   <metadata>
Apr 14 13:33:49 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:33:49 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:33:49 user nova-compute[72019]:       <nova:name>tempest-ServerActionsTestJSON-server-403210657</nova:name>
Apr 14 13:33:49 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:33:48</nova:creationTime>
Apr 14 13:33:49 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:33:49 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:33:49 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:33:49 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:33:49 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:33:49 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:33:49 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:33:49 user nova-compute[72019]:       <nova:owner>
Apr 14 13:33:49 user nova-compute[72019]:         <nova:user uuid="9169729edbd04fd5a74d2cffd0aa437f">tempest-ServerActionsTestJSON-1929049437-project-member</nova:user>
Apr 14 13:33:49 user nova-compute[72019]:         <nova:project uuid="4b197f1df57f4dee9757639cf861eb97">tempest-ServerActionsTestJSON-1929049437</nova:project>
Apr 14 13:33:49 user nova-compute[72019]:       </nova:owner>
Apr 14 13:33:49 user nova-compute[72019]:       <nova:ports>
Apr 14 13:33:49 user nova-compute[72019]:         <nova:port uuid="c7944161-7d6c-4fa8-b0b9-a6e2e3c23203">
Apr 14 13:33:49 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 13:33:49 user nova-compute[72019]:         </nova:port>
Apr 14 13:33:49 user nova-compute[72019]:       </nova:ports>
Apr 14 13:33:49 user nova-compute[72019]:     </nova:instance>
Apr 14 13:33:49 user nova-compute[72019]:   </metadata>
Apr 14 13:33:49 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:33:49 user nova-compute[72019]:     <system>
Apr 14 13:33:49 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:33:49 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:33:49 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:33:49 user nova-compute[72019]:       <entry name="serial">b64515ec-405b-4d02-9195-3b0efe3b5488</entry>
Apr 14 13:33:49 user nova-compute[72019]:       <entry name="uuid">b64515ec-405b-4d02-9195-3b0efe3b5488</entry>
Apr 14 13:33:49 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:33:49 user nova-compute[72019]:     </system>
Apr 14 13:33:49 user nova-compute[72019]:   </sysinfo>
Apr 14 13:33:49 user nova-compute[72019]:   <os>
Apr 14 13:33:49 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:33:49 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:33:49 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:33:49 user nova-compute[72019]:   </os>
Apr 14 13:33:49 user nova-compute[72019]:   <features>
Apr 14 13:33:49 user nova-compute[72019]:     <acpi/>
Apr 14 13:33:49 user nova-compute[72019]:     <apic/>
Apr 14 13:33:49 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:33:49 user nova-compute[72019]:   </features>
Apr 14 13:33:49 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:33:49 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:33:49 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:33:49 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:33:49 user nova-compute[72019]:   </clock>
Apr 14 13:33:49 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:33:49 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:33:49 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:33:49 user nova-compute[72019]:   </cpu>
Apr 14 13:33:49 user nova-compute[72019]:   <devices>
Apr 14 13:33:49 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:33:49 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:33:49 user nova-compute[72019]:       <source dev="/dev/sde"/>
Apr 14 13:33:49 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:33:49 user nova-compute[72019]:       <serial>492fdd47-3fa9-474f-83e3-dfaee2a0c94d</serial>
Apr 14 13:33:49 user nova-compute[72019]:     </disk>
Apr 14 13:33:49 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:33:49 user nova-compute[72019]:       <mac address="fa:16:3e:a2:17:55"/>
Apr 14 13:33:49 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:33:49 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:33:49 user nova-compute[72019]:       <target dev="tapc7944161-7d"/>
Apr 14 13:33:49 user nova-compute[72019]:     </interface>
Apr 14 13:33:49 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:33:49 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/b64515ec-405b-4d02-9195-3b0efe3b5488/console.log" append="off"/>
Apr 14 13:33:49 user nova-compute[72019]:     </serial>
Apr 14 13:33:49 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:33:49 user nova-compute[72019]:     <video>
Apr 14 13:33:49 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:33:49 user nova-compute[72019]:     </video>
Apr 14 13:33:49 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:33:49 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:33:49 user nova-compute[72019]:     </rng>
Apr 14 13:33:49 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:33:49 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:33:49 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:33:49 user nova-compute[72019]:     </memballoon>
Apr 14 13:33:49 user nova-compute[72019]:   </devices>
Apr 14 13:33:49 user nova-compute[72019]: </domain>
Apr 14 13:33:49 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-403210657',display_name='tempest-ServerActionsTestJSON-server-403210657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-403210657',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-olbsjqoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:33:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=b64515ec-405b-4d02-9195-3b0efe3b5488,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:17:55,bridge_name='br-int',has_traffic_filtering=True,id=c7944161-7d6c-4fa8-b0b9-a6e2e3c23203,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7944161-7d') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG os_vif [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:17:55,bridge_name='br-int',has_traffic_filtering=True,id=c7944161-7d6c-4fa8-b0b9-a6e2e3c23203,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7944161-7d') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7944161-7d, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7944161-7d, col_values=(('external_ids', {'iface-id': 'c7944161-7d6c-4fa8-b0b9-a6e2e3c23203', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:17:55', 'vm-uuid': 'b64515ec-405b-4d02-9195-3b0efe3b5488'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:33:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:49 user nova-compute[72019]: INFO os_vif [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:17:55,bridge_name='br-int',has_traffic_filtering=True,id=c7944161-7d6c-4fa8-b0b9-a6e2e3c23203,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7944161-7d')
Apr 14 13:33:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:33:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No VIF found with MAC fa:16:3e:a2:17:55, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:33:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-6a476865-8479-4a4b-88cf-757644734ef4 req-ac564ca0-ccdc-4cb7-9913-025ad50bb58d service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Received event network-vif-plugged-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6a476865-8479-4a4b-88cf-757644734ef4 req-ac564ca0-ccdc-4cb7-9913-025ad50bb58d service nova] Acquiring lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6a476865-8479-4a4b-88cf-757644734ef4 req-ac564ca0-ccdc-4cb7-9913-025ad50bb58d service nova] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-6a476865-8479-4a4b-88cf-757644734ef4 req-ac564ca0-ccdc-4cb7-9913-025ad50bb58d service nova] Lock "31781f5a-460a-41e3-bdcf-9cb20f050ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-6a476865-8479-4a4b-88cf-757644734ef4 req-ac564ca0-ccdc-4cb7-9913-025ad50bb58d service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] No waiting events found dispatching network-vif-plugged-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:33:50 user nova-compute[72019]: WARNING nova.compute.manager [req-6a476865-8479-4a4b-88cf-757644734ef4 req-ac564ca0-ccdc-4cb7-9913-025ad50bb58d service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Received unexpected event network-vif-plugged-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb for instance with vm_state deleted and task_state None.
Apr 14 13:33:50 user nova-compute[72019]: DEBUG nova.compute.manager [req-6a476865-8479-4a4b-88cf-757644734ef4 req-ac564ca0-ccdc-4cb7-9913-025ad50bb58d service nova] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Received event network-vif-deleted-c55e9150-0706-4fa7-9c0c-e94b7aefc8eb {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-e3d445fc-762c-49fd-891f-ca763de4b65b req-1cdf1933-9473-42e4-a9ad-6bcc2b964f42 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received event network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e3d445fc-762c-49fd-891f-ca763de4b65b req-1cdf1933-9473-42e4-a9ad-6bcc2b964f42 service nova] Acquiring lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e3d445fc-762c-49fd-891f-ca763de4b65b req-1cdf1933-9473-42e4-a9ad-6bcc2b964f42 service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e3d445fc-762c-49fd-891f-ca763de4b65b req-1cdf1933-9473-42e4-a9ad-6bcc2b964f42 service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-e3d445fc-762c-49fd-891f-ca763de4b65b req-1cdf1933-9473-42e4-a9ad-6bcc2b964f42 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] No waiting events found dispatching network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:33:51 user nova-compute[72019]: WARNING nova.compute.manager [req-e3d445fc-762c-49fd-891f-ca763de4b65b req-1cdf1933-9473-42e4-a9ad-6bcc2b964f42 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received unexpected event network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance with vm_state building and task_state spawning.
Apr 14 13:33:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479233.3835979, b64515ec-405b-4d02-9195-3b0efe3b5488 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:33:53 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] VM Resumed (Lifecycle Event)
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:33:53 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Instance spawned successfully.
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:33:53 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479233.3847613, b64515ec-405b-4d02-9195-3b0efe3b5488 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:33:53 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] VM Started (Lifecycle Event)
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:33:53 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:33:53 user nova-compute[72019]: INFO nova.compute.manager [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Took 5.11 seconds to spawn the instance on the hypervisor.
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-56945636-9852-4319-a68d-ae5dd8ccb4ec req-2a6b4ed9-e42f-46c6-bef6-84a3c09ec1d3 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received event network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-56945636-9852-4319-a68d-ae5dd8ccb4ec req-2a6b4ed9-e42f-46c6-bef6-84a3c09ec1d3 service nova] Acquiring lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-56945636-9852-4319-a68d-ae5dd8ccb4ec req-2a6b4ed9-e42f-46c6-bef6-84a3c09ec1d3 service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-56945636-9852-4319-a68d-ae5dd8ccb4ec req-2a6b4ed9-e42f-46c6-bef6-84a3c09ec1d3 service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.compute.manager [req-56945636-9852-4319-a68d-ae5dd8ccb4ec req-2a6b4ed9-e42f-46c6-bef6-84a3c09ec1d3 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] No waiting events found dispatching network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:33:53 user nova-compute[72019]: WARNING nova.compute.manager [req-56945636-9852-4319-a68d-ae5dd8ccb4ec req-2a6b4ed9-e42f-46c6-bef6-84a3c09ec1d3 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received unexpected event network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance with vm_state building and task_state spawning.
Apr 14 13:33:53 user nova-compute[72019]: INFO nova.compute.manager [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Took 10.74 seconds to build instance.
Apr 14 13:33:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.832s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:53 user nova-compute[72019]: INFO nova.compute.manager [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Terminating instance
Apr 14 13:33:53 user nova-compute[72019]: DEBUG nova.compute.manager [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:33:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-7eaa50d7-8a1f-4f18-b721-be4220238344 req-408a0bc1-9a33-4bbd-a8d4-25514658c639 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-vif-unplugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7eaa50d7-8a1f-4f18-b721-be4220238344 req-408a0bc1-9a33-4bbd-a8d4-25514658c639 service nova] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7eaa50d7-8a1f-4f18-b721-be4220238344 req-408a0bc1-9a33-4bbd-a8d4-25514658c639 service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7eaa50d7-8a1f-4f18-b721-be4220238344 req-408a0bc1-9a33-4bbd-a8d4-25514658c639 service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-7eaa50d7-8a1f-4f18-b721-be4220238344 req-408a0bc1-9a33-4bbd-a8d4-25514658c639 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] No waiting events found dispatching network-vif-unplugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG nova.compute.manager [req-7eaa50d7-8a1f-4f18-b721-be4220238344 req-408a0bc1-9a33-4bbd-a8d4-25514658c639 service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-vif-unplugged-7d5d9e2b-b502-494a-ac52-70930eda92ac for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:54 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Instance destroyed successfully.
Apr 14 13:33:54 user nova-compute[72019]: DEBUG nova.objects.instance [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'resources' on Instance uuid 626abaa0-3f53-42cc-978e-21f0a80232fa {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1217180291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1217180291',id=39,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:30:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a573d19b775642bba2f2883e0005492d',ramdisk_id='',reservation_id='r-0hfp37ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-740277424',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:32:08Z,user_data=None,user_id='ebc2d46bc1794568841df20b046356c7',uuid=626abaa0-3f53-42cc-978e-21f0a80232fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converting VIF {"id": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "address": "fa:16:3e:15:c3:18", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5d9e2b-b5", "ovs_interfaceid": "7d5d9e2b-b502-494a-ac52-70930eda92ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:c3:18,bridge_name='br-int',has_traffic_filtering=True,id=7d5d9e2b-b502-494a-ac52-70930eda92ac,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5d9e2b-b5') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_vif [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:c3:18,bridge_name='br-int',has_traffic_filtering=True,id=7d5d9e2b-b502-494a-ac52-70930eda92ac,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5d9e2b-b5') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d5d9e2b-b5, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:33:54 user nova-compute[72019]: INFO os_vif [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:c3:18,bridge_name='br-int',has_traffic_filtering=True,id=7d5d9e2b-b502-494a-ac52-70930eda92ac,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5d9e2b-b5')
Apr 14 13:33:54 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcFLujaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:33:54 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f35b20f-29a6-4e7d-aff9-9a8fcce93f40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:33:54 user nova-compute[72019]: No targets found.
Apr 14 13:33:54 user nova-compute[72019]: iSNS:
Apr 14 13:33:54 user nova-compute[72019]: No targets found.
Apr 14 13:33:54 user nova-compute[72019]: STATIC:
Apr 14 13:33:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272
Apr 14 13:33:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:33:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:33:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d
Apr 14 13:33:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:33:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:33:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:33:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:33:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:33:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590
Apr 14 13:33:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:33:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:33:54 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4
Apr 14 13:33:54 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:33:54 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:33:54 user nova-compute[72019]: FIRMWARE:
Apr 14 13:33:54 user nova-compute[72019]: No targets found.
Apr 14 13:33:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:33:54 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:33:54 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a650248e-4fa8-4ee1-9a59-21ab8d5fc494]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb0f938-95ae-4117-bccd-4eb15d15222e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:33:54 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:33:54 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:33:54 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:33:54 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:33:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:33:54 user nova-compute[72019]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 (non-flash)
Apr 14 13:33:54 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:33:54 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:33:54 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:33:54 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74901c11b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272'): ({'sdf'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Removing single pathed devices sdf {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6526a5c4-3181-4898-82bc-c2db757630b7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa59f8e-d7dc-4dea-9951-1c58d1ce5492]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flushing IO for device /dev/sdf {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7b3c13-4396-4648-b27f-ac7a2ed5a67f]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5461b02f-eba1-4edd-af98-4b6673912be6]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] SCSI volumes sdf have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23363363761323831', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f14c9ebf', '/dev/disk/by-id/scsi-1SCST_BIOf14c9ebf-3c67a2815a0b731d') {{(pid=82397) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 13:33:54 user nova-compute[72019]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23363363761323831
Apr 14 13:33:54 user nova-compute[72019]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f14c9ebf
Apr 14 13:33:54 user nova-compute[72019]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOf14c9ebf-3c67a2815a0b731d
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f062f76-b7a0-4723-b969-4693b5bd50f2]: (4, None) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[30783f5e-8289-47a3-80d4-9e3d8af24b1d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:54 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3363f9-783b-449d-bc6b-0f93c027ffb1]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272, portal: 172.16.0.220,3260]
Apr 14 13:33:55 user nova-compute[72019]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272, portal: 172.16.0.220,3260] successful.
Apr 14 13:33:55 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:55 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e65ce2e-31ed-49fb-81e0-dd8f8e767272 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:55 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[498818d7-0102-41ee-a6da-f8dd34689b4f]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:33:55 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] <== disconnect_volume: return (348ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:33:55 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:33:55 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Deleting instance files /opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa_del
Apr 14 13:33:55 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Deletion of /opt/stack/data/nova/instances/626abaa0-3f53-42cc-978e-21f0a80232fa_del complete
Apr 14 13:33:55 user nova-compute[72019]: INFO nova.compute.manager [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 14 13:33:55 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:33:55 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:33:55 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:33:56 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:33:56 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Took 0.95 seconds to deallocate network for instance.
Apr 14 13:33:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-796ed71e-06b8-4017-82c0-3aae91f19a02 req-b086effe-6eac-4b04-bc1a-f3eee4fbf3dd service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-796ed71e-06b8-4017-82c0-3aae91f19a02 req-b086effe-6eac-4b04-bc1a-f3eee4fbf3dd service nova] Acquiring lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-796ed71e-06b8-4017-82c0-3aae91f19a02 req-b086effe-6eac-4b04-bc1a-f3eee4fbf3dd service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:56 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-796ed71e-06b8-4017-82c0-3aae91f19a02 req-b086effe-6eac-4b04-bc1a-f3eee4fbf3dd service nova] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-796ed71e-06b8-4017-82c0-3aae91f19a02 req-b086effe-6eac-4b04-bc1a-f3eee4fbf3dd service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] No waiting events found dispatching network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:33:56 user nova-compute[72019]: WARNING nova.compute.manager [req-796ed71e-06b8-4017-82c0-3aae91f19a02 req-b086effe-6eac-4b04-bc1a-f3eee4fbf3dd service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received unexpected event network-vif-plugged-7d5d9e2b-b502-494a-ac52-70930eda92ac for instance with vm_state active and task_state deleting.
Apr 14 13:33:56 user nova-compute[72019]: DEBUG nova.compute.manager [req-796ed71e-06b8-4017-82c0-3aae91f19a02 req-b086effe-6eac-4b04-bc1a-f3eee4fbf3dd service nova] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Received event network-vif-deleted-7d5d9e2b-b502-494a-ac52-70930eda92ac {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:56 user nova-compute[72019]: INFO nova.compute.manager [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Took 0.85 seconds to detach 1 volumes for instance.
Apr 14 13:33:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-456a3c73-e9ee-473d-b08d-20889d198f5d req-77915b8b-506c-4382-85af-7d34fd3f26d5 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-changed-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG nova.compute.manager [req-456a3c73-e9ee-473d-b08d-20889d198f5d req-77915b8b-506c-4382-85af-7d34fd3f26d5 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Refreshing instance network info cache due to event network-changed-2a3ecee8-e3fc-433e-81d5-f0c9decfd248. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-456a3c73-e9ee-473d-b08d-20889d198f5d req-77915b8b-506c-4382-85af-7d34fd3f26d5 service nova] Acquiring lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-456a3c73-e9ee-473d-b08d-20889d198f5d req-77915b8b-506c-4382-85af-7d34fd3f26d5 service nova] Acquired lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG nova.network.neutron [req-456a3c73-e9ee-473d-b08d-20889d198f5d req-77915b8b-506c-4382-85af-7d34fd3f26d5 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Refreshing network info cache for port 2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:57 user nova-compute[72019]: INFO nova.compute.manager [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Terminating instance
Apr 14 13:33:57 user nova-compute[72019]: DEBUG nova.compute.manager [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:57 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Deleted allocations for instance 626abaa0-3f53-42cc-978e-21f0a80232fa
Apr 14 13:33:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "626abaa0-3f53-42cc-978e-21f0a80232fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.617s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG nova.network.neutron [req-456a3c73-e9ee-473d-b08d-20889d198f5d req-77915b8b-506c-4382-85af-7d34fd3f26d5 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updated VIF entry in instance network info cache for port 2a3ecee8-e3fc-433e-81d5-f0c9decfd248. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG nova.network.neutron [req-456a3c73-e9ee-473d-b08d-20889d198f5d req-77915b8b-506c-4382-85af-7d34fd3f26d5 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updating instance_info_cache with network_info: [{"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-456a3c73-e9ee-473d-b08d-20889d198f5d req-77915b8b-506c-4382-85af-7d34fd3f26d5 service nova] Releasing lock "refresh_cache-04cf64b3-e51b-418f-94f6-7597c4cd74bb" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:57 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Instance destroyed successfully.
Apr 14 13:33:57 user nova-compute[72019]: DEBUG nova.objects.instance [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lazy-loading 'resources' on Instance uuid 04cf64b3-e51b-418f-94f6-7597c4cd74bb {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T13:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-548766851',display_name='tempest-TestShelveInstance-server-548766851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-548766851',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIS8eIL/I3kxODqxFDmjVZgbwaBnYYyEpymoIT8frdOJIbK3dXh9J9GGKAL9gBIvS+6clwDRwZVCayK/ppHQaSnk+tDF7XA0oMOuQgWly6j9ws3NqPQ/uDU7zZbqKPJbIA==',key_name='tempest-TestShelveInstance-1155531040',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ba9f3b2ecb541aba4516734fdebd316',ramdisk_id='',reservation_id='r-6bf35sr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-615050191',owner_user_name='tempest-TestShelveInstance-615050191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:32:21Z,user_data=None,user_id='01b25b886ade4e6ea689010d655d99a0',uuid=04cf64b3-e51b-418f-94f6-7597c4cd74bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Converting VIF {"id": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "address": "fa:16:3e:ad:c4:3d", "network": {"id": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c", "bridge": "br-int", "label": "tempest-TestShelveInstance-959166931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ba9f3b2ecb541aba4516734fdebd316", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3ecee8-e3", "ovs_interfaceid": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c4:3d,bridge_name='br-int',has_traffic_filtering=True,id=2a3ecee8-e3fc-433e-81d5-f0c9decfd248,network=Network(0a7d4ddd-e535-4d06-a605-a34d3ef8188c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3ecee8-e3') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG os_vif [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c4:3d,bridge_name='br-int',has_traffic_filtering=True,id=2a3ecee8-e3fc-433e-81d5-f0c9decfd248,network=Network(0a7d4ddd-e535-4d06-a605-a34d3ef8188c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3ecee8-e3') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a3ecee8-e3, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:57 user nova-compute[72019]: INFO os_vif [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:c4:3d,bridge_name='br-int',has_traffic_filtering=True,id=2a3ecee8-e3fc-433e-81d5-f0c9decfd248,network=Network(0a7d4ddd-e535-4d06-a605-a34d3ef8188c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3ecee8-e3')
Apr 14 13:33:57 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAkcHOeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:33:57 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:33:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7096ef7-5a08-4bc6-85f1-701f3d37cf16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:33:57 user nova-compute[72019]: No targets found.
Apr 14 13:33:57 user nova-compute[72019]: iSNS:
Apr 14 13:33:57 user nova-compute[72019]: No targets found.
Apr 14 13:33:57 user nova-compute[72019]: STATIC:
Apr 14 13:33:57 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d
Apr 14 13:33:57 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:33:57 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:33:57 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:33:57 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:33:57 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:33:57 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590
Apr 14 13:33:57 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:33:57 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:33:57 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4
Apr 14 13:33:57 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:33:57 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:33:57 user nova-compute[72019]: FIRMWARE:
Apr 14 13:33:57 user nova-compute[72019]: No targets found.
Apr 14 13:33:57 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:33:57 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:33:57 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:33:57 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[58922403-221a-4460-9a96-be268cecda95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[180719b8-618d-43ed-bc44-5d149dae3f0d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:33:58 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:33:58 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:33:58 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:33:58 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:33:58 user nova-compute[72019]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 (non-flash)
Apr 14 13:33:58 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:33:58 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:33:58 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74646d1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590'): ({'sdb'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Removing single pathed devices sdb {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42d5654-bf62-4cf7-ae3e-c14412aab5cb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[072fb1ce-caae-4824-a942-19c9a717b1cf]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Flushing IO for device /dev/sdb {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6919bfc7-cdb8-401f-8d0f-b1655949b1c3]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ece108e-c9c4-4ddf-8ec9-4b8ca9a68a6c]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a78fd5-2e0a-424b-ad71-73511febe398]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db98f3c-dad3-4a98-a6c7-797a34109595]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260]
Apr 14 13:33:58 user nova-compute[72019]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590, portal: 172.16.0.220,3260] successful.
Apr 14 13:33:58 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2724b817-0ad1-4678-9429-3f4e67a0f590 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89e43dd-e4ba-486b-8e7e-912282a3a816]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] <== disconnect_volume: return (374ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:33:58 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Deleting instance files /opt/stack/data/nova/instances/04cf64b3-e51b-418f-94f6-7597c4cd74bb_del
Apr 14 13:33:58 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Deletion of /opt/stack/data/nova/instances/04cf64b3-e51b-418f-94f6-7597c4cd74bb_del complete
Apr 14 13:33:58 user nova-compute[72019]: INFO nova.compute.manager [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Took 1.27 seconds to destroy the instance on the hypervisor.
Apr 14 13:33:58 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:33:58 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:33:58 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Took 0.57 seconds to deallocate network for instance.
Apr 14 13:33:58 user nova-compute[72019]: DEBUG nova.compute.manager [req-1bd699c3-5272-44fc-ab5d-f12915fea088 req-92cdbbf0-5cf3-4f2e-97b8-c353efb31365 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-deleted-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-unplugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] No waiting events found dispatching network-vif-unplugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-unplugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] No waiting events found dispatching network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:33:59 user nova-compute[72019]: WARNING nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received unexpected event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance with vm_state active and task_state deleting.
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] No waiting events found dispatching network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:33:59 user nova-compute[72019]: WARNING nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received unexpected event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance with vm_state active and task_state deleting.
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] No waiting events found dispatching network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:33:59 user nova-compute[72019]: WARNING nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received unexpected event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance with vm_state active and task_state deleting.
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-unplugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] No waiting events found dispatching network-vif-unplugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-unplugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Acquiring lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] No waiting events found dispatching network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:33:59 user nova-compute[72019]: WARNING nova.compute.manager [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Received unexpected event network-vif-plugged-2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance with vm_state active and task_state deleting.
Apr 14 13:33:59 user nova-compute[72019]: INFO nova.compute.manager [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Took 0.85 seconds to detach 1 volumes for instance.
Apr 14 13:33:59 user nova-compute[72019]: DEBUG nova.compute.manager [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Deleting volume: 2724b817-0ad1-4678-9429-3f4e67a0f590 {{(pid=72019) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:33:59 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:00 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:34:00 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:34:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:00 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Deleted allocations for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb
Apr 14 13:34:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "04cf64b3-e51b-418f-94f6-7597c4cd74bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.237s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:03 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479228.5464761, 31781f5a-460a-41e3-bdcf-9cb20f050ba3 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:34:03 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] VM Stopped (Lifecycle Event)
Apr 14 13:34:03 user nova-compute[72019]: DEBUG nova.compute.manager [None req-8e763750-ca64-49c3-a3d2-83eab70ee8ef None None] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:34:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:09 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479234.7013512, 626abaa0-3f53-42cc-978e-21f0a80232fa => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:34:09 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] VM Stopped (Lifecycle Event)
Apr 14 13:34:09 user nova-compute[72019]: DEBUG nova.compute.manager [None req-03b2e592-fe76-4d41-b8b6-c4699b24b870 None None] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:34:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:12 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479237.9025183, 04cf64b3-e51b-418f-94f6-7597c4cd74bb => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:34:12 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] VM Stopped (Lifecycle Event)
Apr 14 13:34:12 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3fe3be98-a2b2-41ca-936c-ac5f8bfb86f2 None None] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:34:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:34:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-040ffc54-a822-4208-a0f9-10e634c557c3 req-aafd7808-848a-4c3c-a49b-4481418d7372 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Received event network-changed-a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:34:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-040ffc54-a822-4208-a0f9-10e634c557c3 req-aafd7808-848a-4c3c-a49b-4481418d7372 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Refreshing instance network info cache due to event network-changed-a23e9593-5778-4287-890a-07585622bc27. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:34:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-040ffc54-a822-4208-a0f9-10e634c557c3 req-aafd7808-848a-4c3c-a49b-4481418d7372 service nova] Acquiring lock "refresh_cache-5f323dce-be29-4437-8992-4bfec3ba29ab" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:34:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-040ffc54-a822-4208-a0f9-10e634c557c3 req-aafd7808-848a-4c3c-a49b-4481418d7372 service nova] Acquired lock "refresh_cache-5f323dce-be29-4437-8992-4bfec3ba29ab" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:34:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-040ffc54-a822-4208-a0f9-10e634c557c3 req-aafd7808-848a-4c3c-a49b-4481418d7372 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Refreshing network info cache for port a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:34:24 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:34:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-040ffc54-a822-4208-a0f9-10e634c557c3 req-aafd7808-848a-4c3c-a49b-4481418d7372 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Updated VIF entry in instance network info cache for port a23e9593-5778-4287-890a-07585622bc27. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:34:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-040ffc54-a822-4208-a0f9-10e634c557c3 req-aafd7808-848a-4c3c-a49b-4481418d7372 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Updating instance_info_cache with network_info: [{"id": "a23e9593-5778-4287-890a-07585622bc27", "address": "fa:16:3e:c5:57:b3", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e9593-57", "ovs_interfaceid": "a23e9593-5778-4287-890a-07585622bc27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:34:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-040ffc54-a822-4208-a0f9-10e634c557c3 req-aafd7808-848a-4c3c-a49b-4481418d7372 service nova] Releasing lock "refresh_cache-5f323dce-be29-4437-8992-4bfec3ba29ab" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:34:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:29 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:34:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG nova.objects.instance [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'flavor' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:31 user nova-compute[72019]: INFO nova.compute.manager [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Attaching volume 9f53f31e-30b8-43bc-8e15-d99dc1bedeaa to /dev/vdb
Apr 14 13:34:31 user nova-compute[72019]: DEBUG os_brick.utils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[214774e3-84af-44da-b341-8194360e4829]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab4c91a-9191-43e9-9867-b41cf9f2cda5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[854aaafa-406b-48cc-bb1e-0bb712ebf7dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[efeb9808-deb7-4311-a6d3-8aeb19a46fd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:34:31 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:34:31 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3bfc2d-550f-4c76-ae26-22f743430ac5]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:34:31 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:34:32 user nova-compute[72019]: DEBUG os_brick.utils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:34:32 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Updating existing volume attachment record: 43ef0b66-4c40-4f75-8dba-6bd12f2ad44e {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:34:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:32 user nova-compute[72019]: DEBUG nova.compute.manager [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Starting instance... {{(pid=72019) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 13:34:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:32 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:32 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:34:32 user nova-compute[72019]: INFO nova.compute.claims [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Claim successful on node user
Apr 14 13:34:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Start building networks asynchronously for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Allocating IP information in the background. {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG nova.network.neutron [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] allocate_for_instance() {{(pid=72019) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 13:34:33 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 13:34:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Start building block device mappings for instance. {{(pid=72019) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 13:34:33 user nova-compute[72019]: INFO nova.virt.block_device [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Booting with volume fa139a63-05a5-4336-97a0-e22d07bcd8df at /dev/vda
Apr 14 13:34:33 user nova-compute[72019]: DEBUG nova.policy [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72019) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG os_brick.utils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aa051a-e0eb-45e4-ac25-5f6692aee185]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d27a96-1c6d-4967-a6e3-25b2e36cabf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf10655-9733-4e8c-a73b-d8e5ceed9f61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4617446a-a44d-4fbb-8482-5c45b2e82cf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:34:33 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bf5274-df45-4f8f-afee-f635a527397f]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG os_brick.utils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Updating existing volume attachment record: 0b6c1b41-f7d0-4d9b-8f0d-e79ba4a6ad91 {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:34:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:34:34 user nova-compute[72019]: DEBUG nova.network.neutron [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Successfully created port: efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 13:34:35 user nova-compute[72019]: DEBUG nova.network.neutron [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Successfully updated port: efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 13:34:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "refresh_cache-5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:34:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquired lock "refresh_cache-5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:34:35 user nova-compute[72019]: DEBUG nova.network.neutron [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:34:35 user nova-compute[72019]: DEBUG nova.compute.manager [req-e3f2024d-7517-4344-828e-a9a7abe18455 req-5b21beee-0235-4f8f-bbe8-a2525500c09d service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Received event network-changed-efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:34:35 user nova-compute[72019]: DEBUG nova.compute.manager [req-e3f2024d-7517-4344-828e-a9a7abe18455 req-5b21beee-0235-4f8f-bbe8-a2525500c09d service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Refreshing instance network info cache due to event network-changed-efa8cf9b-10fd-48d5-a01d-160cb930bc07. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:34:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e3f2024d-7517-4344-828e-a9a7abe18455 req-5b21beee-0235-4f8f-bbe8-a2525500c09d service nova] Acquiring lock "refresh_cache-5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:34:35 user nova-compute[72019]: DEBUG nova.network.neutron [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Instance cache missing network info. {{(pid=72019) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 13:34:35 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:34:35 user nova-compute[72019]: DEBUG nova.network.neutron [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Updating instance_info_cache with network_info: [{"id": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "address": "fa:16:3e:90:5e:ee", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa8cf9b-10", "ovs_interfaceid": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:34:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Releasing lock "refresh_cache-5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:34:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Instance network_info: |[{"id": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "address": "fa:16:3e:90:5e:ee", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa8cf9b-10", "ovs_interfaceid": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72019) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 13:34:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e3f2024d-7517-4344-828e-a9a7abe18455 req-5b21beee-0235-4f8f-bbe8-a2525500c09d service nova] Acquired lock "refresh_cache-5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:34:35 user nova-compute[72019]: DEBUG nova.network.neutron [req-e3f2024d-7517-4344-828e-a9a7abe18455 req-5b21beee-0235-4f8f-bbe8-a2525500c09d service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Refreshing network info cache for port efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:34:36 user nova-compute[72019]: DEBUG nova.network.neutron [req-e3f2024d-7517-4344-828e-a9a7abe18455 req-5b21beee-0235-4f8f-bbe8-a2525500c09d service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Updated VIF entry in instance network info cache for port efa8cf9b-10fd-48d5-a01d-160cb930bc07. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:34:36 user nova-compute[72019]: DEBUG nova.network.neutron [req-e3f2024d-7517-4344-828e-a9a7abe18455 req-5b21beee-0235-4f8f-bbe8-a2525500c09d service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Updating instance_info_cache with network_info: [{"id": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "address": "fa:16:3e:90:5e:ee", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa8cf9b-10", "ovs_interfaceid": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:34:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e3f2024d-7517-4344-828e-a9a7abe18455 req-5b21beee-0235-4f8f-bbe8-a2525500c09d service nova] Releasing lock "refresh_cache-5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:34:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:34:36 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:34:36 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Rebuilding the list of instances to heal {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 13:34:36 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Skipping network cache update for instance because it is Building. {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 13:34:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:34:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:34:36 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:34:36 user nova-compute[72019]: DEBUG nova.objects.instance [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lazy-loading 'info_cache' on Instance uuid 978f6fc8-1080-4840-ab8a-e025efe4f906 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:34:37 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Updating instance_info_cache with network_info: [{"id": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "address": "fa:16:3e:7a:a4:82", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6952bc-e5", "ovs_interfaceid": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:34:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-978f6fc8-1080-4840-ab8a-e025efe4f906" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:34:37 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:34:37 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:34:37 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:34:37 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:34:37 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:34:39 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:34:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:39 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:34:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJGNWIAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:34:41 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:34:41 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:34:41 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:41 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:34:41 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=8028MB free_disk=25.95217514038086GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aff69ee-6c99-4808-89ce-b2d247464f63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:34:41 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea7377f-f635-4a3e-b37d-0825a578966a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa] added
Apr 14 13:34:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc94f23d-dfe3-40df-9112-50b4a82359ba]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0c95de-cce6-426e-8915-be420a21174b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJGNWIAf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJGNWIAf" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf04e1c-090a-4e37-ac82-ac90e6bf14b4]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VJGNWIAf'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b7cdf352-a517-4296-bc70-400836915095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 03b76423-23ff-4721-8300-b198286c109a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance fe769254-aa7a-4038-abb6-18628dbcd227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 5f323dce-be29-4437-8992-4bfec3ba29ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b64515ec-405b-4d02-9195-3b0efe3b5488 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dd23dc-730f-4a69-91d8-77eb50bce000]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f165ef6-f316-4988-80f1-ff603542ebfb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:34:41 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:34:41 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:34:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:34:41 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:34:41 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:34:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4670aebd-7f64-4ee5-9a1e-7be4a3fa0432]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa, portal: 172.16.0.220,3260]
Apr 14 13:34:41 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa, portal: 172.16.0.220,3260] successful.
Apr 14 13:34:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[985883de-27d1-48b6-8b4f-d5b222d45b65]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[312829a7-82a5-4c1b-8a27-99fa57d50d83]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:34:41 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:34:41 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:34:41 user nova-compute[72019]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa (non-flash)
Apr 14 13:34:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:34:41 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:34:41 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:34:41 user nova-compute[72019]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa (non-flash)
Apr 14 13:34:41 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb401441-ef7c-40f2-976d-4199635ead48]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:34:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJGNWIAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:34:42 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:34:42 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:34:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:34:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:34:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23965663337656134', 'path': '/dev/sdb'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:34:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965663337656134', 'path': '/dev/sdb'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:34:42 user nova-compute[72019]: DEBUG nova.objects.instance [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'flavor' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:34:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:34:43 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:34:43 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:34:43 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:34:43 user nova-compute[72019]:   <serial>9f53f31e-30b8-43bc-8e15-d99dc1bedeaa</serial>
Apr 14 13:34:43 user nova-compute[72019]: </disk>
Apr 14 13:34:43 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:34:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:34:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:34:43 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] No VIF found with MAC fa:16:3e:3e:80:6a, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:34:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.744s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Start spawning the instance on the hypervisor. {{(pid=72019) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Creating instance directory {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 13:34:44 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Creating image(s)
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Ensure instance console log exists: /opt/stack/data/nova/instances/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Start _get_guest_xml network_info=[{"id": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "address": "fa:16:3e:90:5e:ee", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa8cf9b-10", "ovs_interfaceid": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '0b6c1b41-f7d0-4d9b-8f0d-e79ba4a6ad91', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLXVUJim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa139a63-05a5-4336-97a0-e22d07bcd8df', 'serial': 'fa139a63-05a5-4336-97a0-e22d07bcd8df'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:34:44 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:34:44 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLXVUJim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:34:44 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:34:44 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:34:44 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:34:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1326f83-8beb-4d08-a6aa-62b79647596c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:34:44 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[76917b5a-f575-4f84-9de5-459e4e6ef2f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df] added
Apr 14 13:34:44 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[854a6fe6-197f-44d6-b5f6-2d112029012b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c107e022-333a-424c-9e57-09e85035e24b]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cLXVUJim {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cLXVUJim" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24f88ae-fa71-4d06-a54c-98a2c1ca6730]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cLXVUJim'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b0cb49-0acc-4716-980d-922bd5a5c1c5]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3012a1b5-7d8c-4e69-92b5-32c614d264e1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:34:44 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:34:44 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:34:44 user nova-compute[72019]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa (non-flash)
Apr 14 13:34:44 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:34:44 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:34:44 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:34:44 user nova-compute[72019]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa (non-flash)
Apr 14 13:34:44 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[892040ca-ffe3-493f-8f0c-369d9aaa0343]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df, portal: 172.16.0.220,3260]
Apr 14 13:34:44 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df, portal: 172.16.0.220,3260] successful.
Apr 14 13:34:44 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5318e49-b69a-47e2-a776-7ad1e22a9599]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea12ed8c-e702-4d31-9995-3b83384b3be1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:34:44 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:34:44 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:34:44 user nova-compute[72019]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa (non-flash)
Apr 14 13:34:44 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:34:44 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:34:44 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:34:44 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:34:44 user nova-compute[72019]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa (non-flash)
Apr 14 13:34:44 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:34:44 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HCTL ('37', '-', '-', 0) found on session 51 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.077s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd5eed6-9c62-41d3-88c5-844e6f41c680]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Searching for a device in session 51 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLXVUJim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "911be82f-bcf1-4b02-a218-ab977b28afe1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:44 user nova-compute[72019]: INFO nova.compute.manager [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Terminating instance
Apr 14 13:34:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:44 user nova-compute[72019]: INFO nova.compute.manager [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Detaching volume 9f53f31e-30b8-43bc-8e15-d99dc1bedeaa
Apr 14 13:34:45 user nova-compute[72019]: INFO nova.virt.block_device [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Attempting to driver detach volume 9f53f31e-30b8-43bc-8e15-d99dc1bedeaa from mountpoint /dev/vdb
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Attempting to detach device vdb from instance 03b76423-23ff-4721-8300-b198286c109a from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:34:45 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:34:45 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:34:45 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:34:45 user nova-compute[72019]:   <serial>9f53f31e-30b8-43bc-8e15-d99dc1bedeaa</serial>
Apr 14 13:34:45 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:34:45 user nova-compute[72019]: </disk>
Apr 14 13:34:45 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:34:45 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Successfully detached device vdb from instance 03b76423-23ff-4721-8300-b198286c109a from the persistent domain config.
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03b76423-23ff-4721-8300-b198286c109a from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:34:45 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:34:45 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:34:45 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:34:45 user nova-compute[72019]:   <serial>9f53f31e-30b8-43bc-8e15-d99dc1bedeaa</serial>
Apr 14 13:34:45 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:34:45 user nova-compute[72019]: </disk>
Apr 14 13:34:45 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.compute.manager [req-e8694122-aed7-4152-a1f5-668c069a42d8 req-cb49e755-b8c8-405b-bc15-e615fb0d8c10 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Received event network-vif-unplugged-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e8694122-aed7-4152-a1f5-668c069a42d8 req-cb49e755-b8c8-405b-bc15-e615fb0d8c10 service nova] Acquiring lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e8694122-aed7-4152-a1f5-668c069a42d8 req-cb49e755-b8c8-405b-bc15-e615fb0d8c10 service nova] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e8694122-aed7-4152-a1f5-668c069a42d8 req-cb49e755-b8c8-405b-bc15-e615fb0d8c10 service nova] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.compute.manager [req-e8694122-aed7-4152-a1f5-668c069a42d8 req-cb49e755-b8c8-405b-bc15-e615fb0d8c10 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] No waiting events found dispatching network-vif-unplugged-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.compute.manager [req-e8694122-aed7-4152-a1f5-668c069a42d8 req-cb49e755-b8c8-405b-bc15-e615fb0d8c10 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Received event network-vif-unplugged-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '26438626566613533', 'path': '/dev/sdf'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438626566613533', 'path': '/dev/sdf'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1569614272',display_name='tempest-TestVolumeBootPattern-server-1569614272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1569614272',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn0p0IUuVWoQy0dGsU9Pfuky6ks2ZRYQtS2s2AMQUPgWS/ZFj3/9xG//6C/vHeESCtbDFovyBlscNk5g1knYdZi4/iSS7XffFRPqq5TMnScynxdTnC9z463yGcQBrDWEQ==',key_name='tempest-TestVolumeBootPattern-212867192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-tc2fnsrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:34:33Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "address": "fa:16:3e:90:5e:ee", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa8cf9b-10", "ovs_interfaceid": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "address": "fa:16:3e:90:5e:ee", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa8cf9b-10", "ovs_interfaceid": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:5e:ee,bridge_name='br-int',has_traffic_filtering=True,id=efa8cf9b-10fd-48d5-a01d-160cb930bc07,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa8cf9b-10') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.objects.instance [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lazy-loading 'pci_devices' on Instance uuid 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:34:45 user nova-compute[72019]:   <uuid>5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1</uuid>
Apr 14 13:34:45 user nova-compute[72019]:   <name>instance-0000002f</name>
Apr 14 13:34:45 user nova-compute[72019]:   <memory>131072</memory>
Apr 14 13:34:45 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:34:45 user nova-compute[72019]:   <metadata>
Apr 14 13:34:45 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:34:45 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:34:45 user nova-compute[72019]:       <nova:name>tempest-TestVolumeBootPattern-server-1569614272</nova:name>
Apr 14 13:34:45 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:34:44</nova:creationTime>
Apr 14 13:34:45 user nova-compute[72019]:       <nova:flavor name="m1.nano">
Apr 14 13:34:45 user nova-compute[72019]:         <nova:memory>128</nova:memory>
Apr 14 13:34:45 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:34:45 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:34:45 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:34:45 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:34:45 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:34:45 user nova-compute[72019]:       <nova:owner>
Apr 14 13:34:45 user nova-compute[72019]:         <nova:user uuid="bb40413bd0c3490d97b997f69c930f72">tempest-TestVolumeBootPattern-1645546988-project-member</nova:user>
Apr 14 13:34:45 user nova-compute[72019]:         <nova:project uuid="818de6fa330c4c87a3b6228345d9f13a">tempest-TestVolumeBootPattern-1645546988</nova:project>
Apr 14 13:34:45 user nova-compute[72019]:       </nova:owner>
Apr 14 13:34:45 user nova-compute[72019]:       <nova:ports>
Apr 14 13:34:45 user nova-compute[72019]:         <nova:port uuid="efa8cf9b-10fd-48d5-a01d-160cb930bc07">
Apr 14 13:34:45 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 13:34:45 user nova-compute[72019]:         </nova:port>
Apr 14 13:34:45 user nova-compute[72019]:       </nova:ports>
Apr 14 13:34:45 user nova-compute[72019]:     </nova:instance>
Apr 14 13:34:45 user nova-compute[72019]:   </metadata>
Apr 14 13:34:45 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:34:45 user nova-compute[72019]:     <system>
Apr 14 13:34:45 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:34:45 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:34:45 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:34:45 user nova-compute[72019]:       <entry name="serial">5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1</entry>
Apr 14 13:34:45 user nova-compute[72019]:       <entry name="uuid">5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1</entry>
Apr 14 13:34:45 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:34:45 user nova-compute[72019]:     </system>
Apr 14 13:34:45 user nova-compute[72019]:   </sysinfo>
Apr 14 13:34:45 user nova-compute[72019]:   <os>
Apr 14 13:34:45 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:34:45 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:34:45 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:34:45 user nova-compute[72019]:   </os>
Apr 14 13:34:45 user nova-compute[72019]:   <features>
Apr 14 13:34:45 user nova-compute[72019]:     <acpi/>
Apr 14 13:34:45 user nova-compute[72019]:     <apic/>
Apr 14 13:34:45 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:34:45 user nova-compute[72019]:   </features>
Apr 14 13:34:45 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:34:45 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:34:45 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:34:45 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:34:45 user nova-compute[72019]:   </clock>
Apr 14 13:34:45 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:34:45 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:34:45 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:34:45 user nova-compute[72019]:   </cpu>
Apr 14 13:34:45 user nova-compute[72019]:   <devices>
Apr 14 13:34:45 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:34:45 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:34:45 user nova-compute[72019]:       <source dev="/dev/sdf"/>
Apr 14 13:34:45 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:34:45 user nova-compute[72019]:       <serial>fa139a63-05a5-4336-97a0-e22d07bcd8df</serial>
Apr 14 13:34:45 user nova-compute[72019]:     </disk>
Apr 14 13:34:45 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:34:45 user nova-compute[72019]:       <mac address="fa:16:3e:90:5e:ee"/>
Apr 14 13:34:45 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:34:45 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:34:45 user nova-compute[72019]:       <target dev="tapefa8cf9b-10"/>
Apr 14 13:34:45 user nova-compute[72019]:     </interface>
Apr 14 13:34:45 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:34:45 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1/console.log" append="off"/>
Apr 14 13:34:45 user nova-compute[72019]:     </serial>
Apr 14 13:34:45 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:34:45 user nova-compute[72019]:     <video>
Apr 14 13:34:45 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:34:45 user nova-compute[72019]:     </video>
Apr 14 13:34:45 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:34:45 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:34:45 user nova-compute[72019]:     </rng>
Apr 14 13:34:45 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:34:45 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:34:45 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:34:45 user nova-compute[72019]:     </memballoon>
Apr 14 13:34:45 user nova-compute[72019]:   </devices>
Apr 14 13:34:45 user nova-compute[72019]: </domain>
Apr 14 13:34:45 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1569614272',display_name='tempest-TestVolumeBootPattern-server-1569614272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1569614272',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn0p0IUuVWoQy0dGsU9Pfuky6ks2ZRYQtS2s2AMQUPgWS/ZFj3/9xG//6C/vHeESCtbDFovyBlscNk5g1knYdZi4/iSS7XffFRPqq5TMnScynxdTnC9z463yGcQBrDWEQ==',key_name='tempest-TestVolumeBootPattern-212867192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-tc2fnsrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T13:34:33Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "address": "fa:16:3e:90:5e:ee", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa8cf9b-10", "ovs_interfaceid": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "address": "fa:16:3e:90:5e:ee", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa8cf9b-10", "ovs_interfaceid": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:5e:ee,bridge_name='br-int',has_traffic_filtering=True,id=efa8cf9b-10fd-48d5-a01d-160cb930bc07,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa8cf9b-10') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG os_vif [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:5e:ee,bridge_name='br-int',has_traffic_filtering=True,id=efa8cf9b-10fd-48d5-a01d-160cb930bc07,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa8cf9b-10') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefa8cf9b-10, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapefa8cf9b-10, col_values=(('external_ids', {'iface-id': 'efa8cf9b-10fd-48d5-a01d-160cb930bc07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:5e:ee', 'vm-uuid': '5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:45 user nova-compute[72019]: INFO os_vif [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:5e:ee,bridge_name='br-int',has_traffic_filtering=True,id=efa8cf9b-10fd-48d5-a01d-160cb930bc07,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa8cf9b-10')
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] No VIF found with MAC fa:16:3e:90:5e:ee, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681479285.8207238, 03b76423-23ff-4721-8300-b198286c109a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:34:45 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Successfully detached device vdb from instance 03b76423-23ff-4721-8300-b198286c109a from the live domain config.
Apr 14 13:34:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJGNWIAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:34:45 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:34:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcbc267-4bcc-46e9-8116-0b5e3393c9f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:34:45 user nova-compute[72019]: No targets found.
Apr 14 13:34:45 user nova-compute[72019]: iSNS:
Apr 14 13:34:45 user nova-compute[72019]: No targets found.
Apr 14 13:34:45 user nova-compute[72019]: STATIC:
Apr 14 13:34:45 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d
Apr 14 13:34:45 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:34:45 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:34:45 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:34:45 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:34:45 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:34:45 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4
Apr 14 13:34:45 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:34:45 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:34:45 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa
Apr 14 13:34:45 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:34:45 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:34:45 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df
Apr 14 13:34:45 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:34:45 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:34:45 user nova-compute[72019]: FIRMWARE:
Apr 14 13:34:45 user nova-compute[72019]: No targets found.
Apr 14 13:34:45 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:34:45 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:34:45 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[655ce8d7-8dcf-4a75-a7a5-b5cb279c79e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37e553a-4909-49fc-bfe6-82d657c6aaff]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:34:45 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:34:45 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:34:45 user nova-compute[72019]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa (non-flash)
Apr 14 13:34:45 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:34:45 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:34:45 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:34:45 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:34:45 user nova-compute[72019]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa (non-flash)
Apr 14 13:34:45 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:34:45 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74646a3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa'): ({'sdb'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Removing single pathed devices sdb {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[49781ea0-68e6-46fc-aa1b-80f395b0fe1d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bdfe8e-8578-4ccb-98a7-6b82b9362063]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Flushing IO for device /dev/sdb {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad37829-f6a6-459a-b5f8-9b236a0eb405]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bb34dc-b6dc-49b8-94cf-194ac9b8ba59]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63516ad-f45c-4232-91f5-f131ac60af1d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:46 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Instance destroyed successfully.
Apr 14 13:34:46 user nova-compute[72019]: DEBUG nova.objects.instance [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'resources' on Instance uuid 911be82f-bcf1-4b02-a218-ab977b28afe1 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2015588570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2015588570',id=35,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:25:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a573d19b775642bba2f2883e0005492d',ramdisk_id='',reservation_id='r-unbne1fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-740277424',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:27:18Z,user_data=None,user_id='ebc2d46bc1794568841df20b046356c7',uuid=911be82f-bcf1-4b02-a218-ab977b28afe1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "address": "fa:16:3e:bb:f3:4c", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c3bad4-02", "ovs_interfaceid": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converting VIF {"id": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "address": "fa:16:3e:bb:f3:4c", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c3bad4-02", "ovs_interfaceid": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:f3:4c,bridge_name='br-int',has_traffic_filtering=True,id=98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c3bad4-02') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG os_vif [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:f3:4c,bridge_name='br-int',has_traffic_filtering=True,id=98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c3bad4-02') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98c3bad4-02, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:46 user nova-compute[72019]: INFO os_vif [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:f3:4c,bridge_name='br-int',has_traffic_filtering=True,id=98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c3bad4-02')
Apr 14 13:34:46 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Deleting instance files /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1_del
Apr 14 13:34:46 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Deletion of /opt/stack/data/nova/instances/911be82f-bcf1-4b02-a218-ab977b28afe1_del complete
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9011f8-f07e-46ea-b75e-572f407c0514]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa, portal: 172.16.0.220,3260]
Apr 14 13:34:46 user nova-compute[72019]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa, portal: 172.16.0.220,3260] successful.
Apr 14 13:34:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f53f31e-30b8-43bc-8e15-d99dc1bedeaa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1273a029-222f-44f7-98d1-3b51150b926e]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] <== disconnect_volume: return (388ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:34:46 user nova-compute[72019]: INFO nova.compute.manager [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Took 1.47 seconds to destroy the instance on the hypervisor.
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:34:46 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Took 0.66 seconds to deallocate network for instance.
Apr 14 13:34:46 user nova-compute[72019]: DEBUG nova.compute.manager [req-e5c7c045-7174-40fa-9811-b86528cb78ff req-efbc7a63-a516-4aaa-a3e6-82703ee7f694 service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Received event network-vif-deleted-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG nova.objects.instance [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'flavor' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.299s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-b7ffa1e2-f0ad-4e43-bd40-d05c1b40dcaf req-b4eb9c62-90bc-4b2e-90d2-c5281e1bb92d service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Received event network-vif-plugged-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b7ffa1e2-f0ad-4e43-bd40-d05c1b40dcaf req-b4eb9c62-90bc-4b2e-90d2-c5281e1bb92d service nova] Acquiring lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b7ffa1e2-f0ad-4e43-bd40-d05c1b40dcaf req-b4eb9c62-90bc-4b2e-90d2-c5281e1bb92d service nova] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-b7ffa1e2-f0ad-4e43-bd40-d05c1b40dcaf req-b4eb9c62-90bc-4b2e-90d2-c5281e1bb92d service nova] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG nova.compute.manager [req-b7ffa1e2-f0ad-4e43-bd40-d05c1b40dcaf req-b4eb9c62-90bc-4b2e-90d2-c5281e1bb92d service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] No waiting events found dispatching network-vif-plugged-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:34:47 user nova-compute[72019]: WARNING nova.compute.manager [req-b7ffa1e2-f0ad-4e43-bd40-d05c1b40dcaf req-b4eb9c62-90bc-4b2e-90d2-c5281e1bb92d service nova] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Received unexpected event network-vif-plugged-98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 for instance with vm_state deleted and task_state None.
Apr 14 13:34:47 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:47 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Deleted allocations for instance 911be82f-bcf1-4b02-a218-ab977b28afe1
Apr 14 13:34:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "911be82f-bcf1-4b02-a218-ab977b28afe1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.792s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Received event network-vif-plugged-efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] Acquiring lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] Lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] Lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] No waiting events found dispatching network-vif-plugged-efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:34:49 user nova-compute[72019]: WARNING nova.compute.manager [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Received unexpected event network-vif-plugged-efa8cf9b-10fd-48d5-a01d-160cb930bc07 for instance with vm_state building and task_state spawning.
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Received event network-vif-plugged-efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] Acquiring lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] Lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] Lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] No waiting events found dispatching network-vif-plugged-efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:34:49 user nova-compute[72019]: WARNING nova.compute.manager [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Received unexpected event network-vif-plugged-efa8cf9b-10fd-48d5-a01d-160cb930bc07 for instance with vm_state building and task_state spawning.
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479289.6884992, 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:34:49 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] VM Resumed (Lifecycle Event)
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.compute.manager [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Guest created on hypervisor {{(pid=72019) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 13:34:49 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Instance spawned successfully.
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Found default for hw_cdrom_bus of ide {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Found default for hw_disk_bus of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Found default for hw_input_bus of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Found default for hw_pointer_model of None {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Found default for hw_video_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Found default for hw_vif_model of virtio {{(pid=72019) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:34:49 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479289.6899705, 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:34:49 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] VM Started (Lifecycle Event)
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:34:49 user nova-compute[72019]: INFO nova.compute.manager [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Took 5.82 seconds to spawn the instance on the hypervisor.
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.compute.manager [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:34:49 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:34:49 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 13:34:49 user nova-compute[72019]: INFO nova.compute.manager [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Took 17.12 seconds to build instance.
Apr 14 13:34:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.225s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:34:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:34:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:01 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479286.1396918, 911be82f-bcf1-4b02-a218-ab977b28afe1 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:35:01 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] VM Stopped (Lifecycle Event)
Apr 14 13:35:01 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6dd73e92-f45e-474c-949a-e71868fc1294 None None] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:35:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:11 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:24 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:35:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:35:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:35:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:35:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:35:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:35:29 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:35:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:35:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:35:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:35:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:35:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:35:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:35:34 user nova-compute[72019]: DEBUG nova.compute.manager [req-dddbac7d-b878-4f18-9e3f-d1a6dcc947a8 req-465d597e-d485-462e-9b42-4389c9229614 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Received event network-changed-08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:35:34 user nova-compute[72019]: DEBUG nova.compute.manager [req-dddbac7d-b878-4f18-9e3f-d1a6dcc947a8 req-465d597e-d485-462e-9b42-4389c9229614 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Refreshing instance network info cache due to event network-changed-08aca6e2-fbdf-43c4-878a-45558c029e27. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:35:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dddbac7d-b878-4f18-9e3f-d1a6dcc947a8 req-465d597e-d485-462e-9b42-4389c9229614 service nova] Acquiring lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:35:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dddbac7d-b878-4f18-9e3f-d1a6dcc947a8 req-465d597e-d485-462e-9b42-4389c9229614 service nova] Acquired lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:35:34 user nova-compute[72019]: DEBUG nova.network.neutron [req-dddbac7d-b878-4f18-9e3f-d1a6dcc947a8 req-465d597e-d485-462e-9b42-4389c9229614 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Refreshing network info cache for port 08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:35:34 user nova-compute[72019]: DEBUG nova.network.neutron [req-dddbac7d-b878-4f18-9e3f-d1a6dcc947a8 req-465d597e-d485-462e-9b42-4389c9229614 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updated VIF entry in instance network info cache for port 08aca6e2-fbdf-43c4-878a-45558c029e27. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:35:34 user nova-compute[72019]: DEBUG nova.network.neutron [req-dddbac7d-b878-4f18-9e3f-d1a6dcc947a8 req-465d597e-d485-462e-9b42-4389c9229614 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updating instance_info_cache with network_info: [{"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:35:34 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-dddbac7d-b878-4f18-9e3f-d1a6dcc947a8 req-465d597e-d485-462e-9b42-4389c9229614 service nova] Releasing lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:35:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "b7cdf352-a517-4296-bc70-400836915095" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "b7cdf352-a517-4296-bc70-400836915095-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "b7cdf352-a517-4296-bc70-400836915095-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:35 user nova-compute[72019]: INFO nova.compute.manager [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Terminating instance
Apr 14 13:35:35 user nova-compute[72019]: DEBUG nova.compute.manager [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:35:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:35 user nova-compute[72019]: DEBUG nova.compute.manager [req-90f2df35-7ece-4469-bc74-91839107cd46 req-c0496e58-1ee8-46c4-99f3-6105ab247621 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-vif-unplugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:35:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-90f2df35-7ece-4469-bc74-91839107cd46 req-c0496e58-1ee8-46c4-99f3-6105ab247621 service nova] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-90f2df35-7ece-4469-bc74-91839107cd46 req-c0496e58-1ee8-46c4-99f3-6105ab247621 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:35 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-90f2df35-7ece-4469-bc74-91839107cd46 req-c0496e58-1ee8-46c4-99f3-6105ab247621 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:35 user nova-compute[72019]: DEBUG nova.compute.manager [req-90f2df35-7ece-4469-bc74-91839107cd46 req-c0496e58-1ee8-46c4-99f3-6105ab247621 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] No waiting events found dispatching network-vif-unplugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:35:35 user nova-compute[72019]: DEBUG nova.compute.manager [req-90f2df35-7ece-4469-bc74-91839107cd46 req-c0496e58-1ee8-46c4-99f3-6105ab247621 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-vif-unplugged-c5258996-381d-45a2-8447-784b03a4e32e for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:35:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-ca90ea85-8963-41a3-8d68-7eadd86d7226 req-0f8ab578-93e2-4dc8-ab49-f65d3820fafd service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received event network-changed-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.compute.manager [req-ca90ea85-8963-41a3-8d68-7eadd86d7226 req-0f8ab578-93e2-4dc8-ab49-f65d3820fafd service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Refreshing instance network info cache due to event network-changed-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ca90ea85-8963-41a3-8d68-7eadd86d7226 req-0f8ab578-93e2-4dc8-ab49-f65d3820fafd service nova] Acquiring lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ca90ea85-8963-41a3-8d68-7eadd86d7226 req-0f8ab578-93e2-4dc8-ab49-f65d3820fafd service nova] Acquired lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.network.neutron [req-ca90ea85-8963-41a3-8d68-7eadd86d7226 req-0f8ab578-93e2-4dc8-ab49-f65d3820fafd service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Refreshing network info cache for port c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:36 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: b7cdf352-a517-4296-bc70-400836915095] Instance destroyed successfully.
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.objects.instance [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'resources' on Instance uuid b7cdf352-a517-4296-bc70-400836915095 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1188690873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1188690873',id=27,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:21:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a573d19b775642bba2f2883e0005492d',ramdisk_id='',reservation_id='r-rm54dxhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-740277424',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:23:35Z,user_data=None,user_id='ebc2d46bc1794568841df20b046356c7',uuid=b7cdf352-a517-4296-bc70-400836915095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converting VIF {"id": "c5258996-381d-45a2-8447-784b03a4e32e", "address": "fa:16:3e:35:44:e4", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5258996-38", "ovs_interfaceid": "c5258996-381d-45a2-8447-784b03a4e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:44:e4,bridge_name='br-int',has_traffic_filtering=True,id=c5258996-381d-45a2-8447-784b03a4e32e,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5258996-38') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_vif [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:44:e4,bridge_name='br-int',has_traffic_filtering=True,id=c5258996-381d-45a2-8447-784b03a4e32e,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5258996-38') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5258996-38, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:35:36 user nova-compute[72019]: INFO os_vif [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:44:e4,bridge_name='br-int',has_traffic_filtering=True,id=c5258996-381d-45a2-8447-784b03a4e32e,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5258996-38')
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJSeHZPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:35:36 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb5b27c-a664-40c4-b98a-49a59688895c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:35:36 user nova-compute[72019]: No targets found.
Apr 14 13:35:36 user nova-compute[72019]: iSNS:
Apr 14 13:35:36 user nova-compute[72019]: No targets found.
Apr 14 13:35:36 user nova-compute[72019]: STATIC:
Apr 14 13:35:36 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d
Apr 14 13:35:36 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:35:36 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:35:36 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6
Apr 14 13:35:36 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:35:36 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:35:36 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4
Apr 14 13:35:36 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:35:36 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:35:36 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df
Apr 14 13:35:36 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:35:36 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:35:36 user nova-compute[72019]: FIRMWARE:
Apr 14 13:35:36 user nova-compute[72019]: No targets found.
Apr 14 13:35:36 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:35:36 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:35:36 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c415539-0c31-496b-83ee-b8554b763251]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ff890d-7c87-4d00-b2df-03310ae8a3ff]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:35:36 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:35:36 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:35:36 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:35:36 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 (non-flash)
Apr 14 13:35:36 user nova-compute[72019]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:35:36 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:35:36 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:35:36 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f749cb595a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6'): ({'sdc'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Removing single pathed devices sdc {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccd1c58-fd2f-4638-9bff-0ba1f0fa0669]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19519ab-ae04-4632-9ef2-c3ffe44ca660]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flushing IO for device /dev/sdc {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6cd111-c675-410f-8754-7ce4e8512f7a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.compute.manager [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Stashing vm_state: active {{(pid=72019) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4782e675-3080-4211-8e6a-433c3cd0ed42]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] SCSI volumes sdc have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2728731c-14be-4e67-867c-45bbfa9e73e3]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.network.neutron [req-ca90ea85-8963-41a3-8d68-7eadd86d7226 req-0f8ab578-93e2-4dc8-ab49-f65d3820fafd service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updated VIF entry in instance network info cache for port c7944161-7d6c-4fa8-b0b9-a6e2e3c23203. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.network.neutron [req-ca90ea85-8963-41a3-8d68-7eadd86d7226 req-0f8ab578-93e2-4dc8-ab49-f65d3820fafd service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updating instance_info_cache with network_info: [{"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fd45be-18f5-415e-94d4-c2044742d1e4]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6, portal: 172.16.0.220,3260]
Apr 14 13:35:36 user nova-compute[72019]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6, portal: 172.16.0.220,3260] successful.
Apr 14 13:35:36 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-ca90ea85-8963-41a3-8d68-7eadd86d7226 req-0f8ab578-93e2-4dc8-ab49-f65d3820fafd service nova] Releasing lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.objects.instance [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'pci_requests' on Instance uuid b64515ec-405b-4d02-9195-3b0efe3b5488 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0a3b39-55d0-49c4-b1db-4792d0f556d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[046cffb0-3712-4e9a-976d-62a712378c2e]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] <== disconnect_volume: return (411ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:35:36 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Deleting instance files /opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095_del
Apr 14 13:35:36 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Deletion of /opt/stack/data/nova/instances/b7cdf352-a517-4296-bc70-400836915095_del complete
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72019) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 13:35:36 user nova-compute[72019]: INFO nova.compute.claims [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Claim successful on node user
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.objects.instance [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'resources' on Instance uuid b64515ec-405b-4d02-9195-3b0efe3b5488 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:35:36 user nova-compute[72019]: DEBUG nova.objects.instance [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'pci_devices' on Instance uuid b64515ec-405b-4d02-9195-3b0efe3b5488 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:35:37 user nova-compute[72019]: INFO nova.compute.resource_tracker [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updating resource usage from migration b150cbf6-bc86-40a2-9abf-676cf70f390c
Apr 14 13:35:37 user nova-compute[72019]: INFO nova.compute.manager [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Took 1.57 seconds to destroy the instance on the hypervisor.
Apr 14 13:35:37 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: b7cdf352-a517-4296-bc70-400836915095] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: b7cdf352-a517-4296-bc70-400836915095] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.441s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:37 user nova-compute[72019]: INFO nova.compute.manager [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Migrating
Apr 14 13:35:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquired lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG nova.network.neutron [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: b7cdf352-a517-4296-bc70-400836915095] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:35:37 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: b7cdf352-a517-4296-bc70-400836915095] Took 0.57 seconds to deallocate network for instance.
Apr 14 13:35:37 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Skipping network cache update for instance because it is being deleted. {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9841}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 03b76423-23ff-4721-8300-b198286c109a] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG nova.compute.manager [req-7db15359-34bb-4b92-970f-b02611969cf4 req-c7444e1f-2b96-4bcb-bcad-02f3d4eccc93 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7db15359-34bb-4b92-970f-b02611969cf4 req-c7444e1f-2b96-4bcb-bcad-02f3d4eccc93 service nova] Acquiring lock "b7cdf352-a517-4296-bc70-400836915095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7db15359-34bb-4b92-970f-b02611969cf4 req-c7444e1f-2b96-4bcb-bcad-02f3d4eccc93 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-7db15359-34bb-4b92-970f-b02611969cf4 req-c7444e1f-2b96-4bcb-bcad-02f3d4eccc93 service nova] Lock "b7cdf352-a517-4296-bc70-400836915095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG nova.compute.manager [req-7db15359-34bb-4b92-970f-b02611969cf4 req-c7444e1f-2b96-4bcb-bcad-02f3d4eccc93 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] No waiting events found dispatching network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:35:37 user nova-compute[72019]: WARNING nova.compute.manager [req-7db15359-34bb-4b92-970f-b02611969cf4 req-c7444e1f-2b96-4bcb-bcad-02f3d4eccc93 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received unexpected event network-vif-plugged-c5258996-381d-45a2-8447-784b03a4e32e for instance with vm_state active and task_state deleting.
Apr 14 13:35:37 user nova-compute[72019]: DEBUG nova.network.neutron [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updating instance_info_cache with network_info: [{"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:35:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Releasing lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Starting migrate_disk_and_power_off {{(pid=72019) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG nova.compute.manager [req-f30fd51b-4bd7-436b-bf40-e62d09515472 req-236809a7-7ffe-4d14-87a0-76e69b3d2c53 service nova] [instance: b7cdf352-a517-4296-bc70-400836915095] Received event network-vif-deleted-c5258996-381d-45a2-8447-784b03a4e32e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 03b76423-23ff-4721-8300-b198286c109a] Updating instance_info_cache with network_info: [{"id": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "address": "fa:16:3e:3e:80:6a", "network": {"id": "a9168d79-fcda-4f76-82db-8993f13bbff3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1548446165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad49f75bbe9461b936963e8dc6c8be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5670a4df-01", "ovs_interfaceid": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: 03b76423-23ff-4721-8300-b198286c109a] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:38 user nova-compute[72019]: INFO nova.compute.manager [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Took 0.86 seconds to detach 1 volumes for instance.
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:38 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Deleted allocations for instance b7cdf352-a517-4296-bc70-400836915095
Apr 14 13:35:38 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Instance destroyed successfully.
Apr 14 13:35:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-403210657',display_name='tempest-ServerActionsTestJSON-server-403210657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-403210657',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:33:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-olbsjqoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=b64515ec-405b-4d02-9195-3b0efe3b5488,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1832265350-network", "vif_mac": "fa:16:3e:a2:17:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1832265350-network", "vif_mac": "fa:16:3e:a2:17:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:17:55,bridge_name='br-int',has_traffic_filtering=True,id=c7944161-7d6c-4fa8-b0b9-a6e2e3c23203,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7944161-7d') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG os_vif [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:17:55,bridge_name='br-int',has_traffic_filtering=True,id=c7944161-7d6c-4fa8-b0b9-a6e2e3c23203,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7944161-7d') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7944161-7d, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:35:38 user nova-compute[72019]: INFO os_vif [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:17:55,bridge_name='br-int',has_traffic_filtering=True,id=c7944161-7d6c-4fa8-b0b9-a6e2e3c23203,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7944161-7d')
Apr 14 13:35:38 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXtobSsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:35:38 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:35:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e813034-daa2-4a6b-8719-8e06751a8a45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:35:38 user nova-compute[72019]: No targets found.
Apr 14 13:35:38 user nova-compute[72019]: iSNS:
Apr 14 13:35:38 user nova-compute[72019]: No targets found.
Apr 14 13:35:38 user nova-compute[72019]: STATIC:
Apr 14 13:35:38 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d
Apr 14 13:35:38 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:35:38 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:35:38 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4
Apr 14 13:35:38 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:35:38 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:35:38 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df
Apr 14 13:35:38 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:35:38 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:35:38 user nova-compute[72019]: FIRMWARE:
Apr 14 13:35:38 user nova-compute[72019]: No targets found.
Apr 14 13:35:38 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:35:38 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:35:38 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa9c840-2288-457b-b83e-02d771b92fe1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "b7cdf352-a517-4296-bc70-400836915095" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.496s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7224e3ea-c834-400d-ac4f-07a706bed18a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:35:38 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:35:38 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:35:38 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:35:38 user nova-compute[72019]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:35:38 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:35:38 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f749cb59900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d'): ({'sde'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Removing single pathed devices sde {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:35:38 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dead4f2-7a53-4c36-aa53-20ab51a9f829]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a226d541-e55f-475b-8c6c-315fa9d0b468]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flushing IO for device /dev/sde {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[603399f2-80ec-4a5e-9a30-40fef7667374]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac526f0-44f2-43aa-90d3-801d5d873321]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] SCSI volumes sde have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0481adb9-ecd3-4ea9-824a-9cd70fafa096]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d376c4-e306-43e5-ad6e-336c43908ccc]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260]
Apr 14 13:35:39 user nova-compute[72019]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260] successful.
Apr 14 13:35:39 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[96008d79-2c6c-4538-b4f6-741013698434]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== disconnect_volume: return (359ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG nova.objects.instance [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'flavor' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:39 user nova-compute[72019]: INFO nova.compute.manager [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Attaching volume ceb34956-9137-4101-bf06-c0a761320578 to /dev/vdb
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.utils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[929b544d-b6f0-44b4-a938-52cc41997e0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0e5430-5326-458c-8ed0-cbe313dccde5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a75461c-e801-4a4c-a02f-0677c5250e1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff934db-13b1-48e7-850b-02983a21d453]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:35:39 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:35:39 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9ea962-b5f9-4483-98c1-f7f0ee899043]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG os_brick.utils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:35:39 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Updating existing volume attachment record: 9eff96e2-ace4-4a66-b22d-0a1d86f48aea {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG nova.compute.manager [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received event network-vif-unplugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] Acquiring lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG nova.compute.manager [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] No waiting events found dispatching network-vif-unplugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:35:40 user nova-compute[72019]: WARNING nova.compute.manager [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received unexpected event network-vif-unplugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance with vm_state active and task_state resize_migrating.
Apr 14 13:35:40 user nova-compute[72019]: DEBUG nova.compute.manager [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received event network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] Acquiring lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG nova.compute.manager [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] No waiting events found dispatching network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:35:40 user nova-compute[72019]: WARNING nova.compute.manager [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received unexpected event network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance with vm_state active and task_state resize_migrating.
Apr 14 13:35:40 user nova-compute[72019]: DEBUG nova.network.neutron [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Port c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 binding to destination host user is already ACTIVE {{(pid=72019) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquired lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG nova.network.neutron [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG nova.network.neutron [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updating instance_info_cache with network_info: [{"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Releasing lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG os_brick.utils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[977fa900-64c5-42d5-b063-787482b1f0d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e6f759-9ec3-4c6d-8677-10d66e168242]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba600bf2-89d4-498b-b1b4-59f9c547350b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc042bc-a93e-4575-b309-a9f9465c8d95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:35:41 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[313a75ae-6aa7-4348-8003-cf15e97e73c3]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG os_brick.utils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:35:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:35:42 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:35:42 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:35:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=8269MB free_disk=26.023502349853516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Applying migration context for instance b64515ec-405b-4d02-9195-3b0efe3b5488 as it has an incoming, in-progress migration b150cbf6-bc86-40a2-9abf-676cf70f390c. Migration status is post-migrating {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 13:35:42 user nova-compute[72019]: INFO nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updating resource usage from migration b150cbf6-bc86-40a2-9abf-676cf70f390c
Apr 14 13:35:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 03b76423-23ff-4721-8300-b198286c109a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance fe769254-aa7a-4038-abb6-18628dbcd227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 5f323dce-be29-4437-8992-4bfec3ba29ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Migration b150cbf6-bc86-40a2-9abf-676cf70f390c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b64515ec-405b-4d02-9195-3b0efe3b5488 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnIhVUlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:35:44 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:35:44 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:35:44 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ed0ffa-ea47-45b8-afa5-335a261bfd2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:35:44 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab537eef-bb1f-422d-98ac-b1ff079a4e14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578] added
Apr 14 13:35:44 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c178a5-2785-4fef-a1fc-cd3ca2691436]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[43600373-aad0-4d25-9c8b-721ebeedf1a6]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rnIhVUlD {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rnIhVUlD" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc29ff20-5dfb-4659-a445-f97eb046626e]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rnIhVUlD'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[469c6215-e142-47ed-84a4-72a5e60a94ef]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e06d1f-5ed0-4edd-9a21-9beccb4918f0]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:35:44 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:35:44 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:35:44 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:35:44 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb54a14d-c715-4666-acad-49badbb26439]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578, portal: 172.16.0.220,3260]
Apr 14 13:35:44 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578, portal: 172.16.0.220,3260] successful.
Apr 14 13:35:44 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[93620584-0382-4a67-b2f3-f2223493db74]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c03a8f5-983a-490f-be2b-0027c6cb9564]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:35:44 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:35:44 user nova-compute[72019]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 (non-flash)
Apr 14 13:35:44 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:35:44 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:35:44 user nova-compute[72019]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 (non-flash)
Apr 14 13:35:44 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[23306062-f2d9-4ef5-a79d-0ae99b29b23a]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:44 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnIhVUlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26162613764643235', 'path': '/dev/sdb'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162613764643235', 'path': '/dev/sdb'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.objects.instance [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'flavor' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:35:45 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:35:45 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:35:45 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:35:45 user nova-compute[72019]:   <serial>ceb34956-9137-4101-bf06-c0a761320578</serial>
Apr 14 13:35:45 user nova-compute[72019]: </disk>
Apr 14 13:35:45 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Starting finish_migration {{(pid=72019) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Instance directory exists: not creating {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 13:35:45 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Creating image(s)
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Did not create local disks {{(pid=72019) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Ensure instance console log exists: /opt/stack/data/nova/instances/b64515ec-405b-4d02-9195-3b0efe3b5488/console.log {{(pid=72019) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Start _get_guest_xml network_info=[{"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1832265350-network", "vif_mac": "fa:16:3e:a2:17:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '2bd6fa88-6ede-4d1a-b832-3e722d1d9836', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXtobSsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b64515ec-405b-4d02-9195-3b0efe3b5488', 'attached_at': '2023-04-14T13:35:46.000000', 'detached_at': '', 'volume_id': '492fdd47-3fa9-474f-83e3-dfaee2a0c94d', 'serial': '492fdd47-3fa9-474f-83e3-dfaee2a0c94d'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 13:35:45 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:35:45 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72019) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T13:09:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image limits 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image pref 0:0:0 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72019) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Got 1 possible topologies {{(pid=72019) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72019) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.objects.instance [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'vcpu_model' on Instance uuid b64515ec-405b-4d02-9195-3b0efe3b5488 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXtobSsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:35:45 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:35:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:35:45 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:35:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:35:45 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:35:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01676ef-427b-4733-82af-89acbe4b4f5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:35:45 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e24969-22fc-4ed8-88de-3f4438105446]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d] added
Apr 14 13:35:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[24232322-e442-4cda-9dc0-e8bd20049235]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[757c2176-03d5-4041-85b3-7d09b54a652d]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zXtobSsZ {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] No VIF found with MAC fa:16:3e:3e:80:6a, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zXtobSsZ" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e6f2c-23ba-477b-b2dd-c69e9f8b24d2]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zXtobSsZ'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8d2512-4470-4f08-87a0-9a46b1f02b98]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb031080-3619-4385-a232-31ccdf5e3f1e]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:35:46 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:35:46 user nova-compute[72019]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 (non-flash)
Apr 14 13:35:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:35:46 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:35:46 user nova-compute[72019]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 (non-flash)
Apr 14 13:35:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.694s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[591b7086-9f47-4029-94f5-8503eb3de42b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260]
Apr 14 13:35:46 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260] successful.
Apr 14 13:35:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7320b6cd-69f3-4988-bb6f-e639b6501350]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e452bdb0-1765-4db7-b210-5175180cbd88]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:35:46 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:35:46 user nova-compute[72019]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 (non-flash)
Apr 14 13:35:46 user nova-compute[72019]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:35:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:35:46 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:35:46 user nova-compute[72019]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 (non-flash)
Apr 14 13:35:46 user nova-compute[72019]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:35:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced6d83d-ea04-4126-9a5a-1e024c123d28]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:46 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXtobSsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26134656436373231', 'path': '/dev/sdc'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134656436373231', 'path': '/dev/sdc'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-403210657',display_name='tempest-ServerActionsTestJSON-server-403210657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-403210657',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:33:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-olbsjqoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:35:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=b64515ec-405b-4d02-9195-3b0efe3b5488,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1832265350-network", "vif_mac": "fa:16:3e:a2:17:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72019) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1832265350-network", "vif_mac": "fa:16:3e:a2:17:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:17:55,bridge_name='br-int',has_traffic_filtering=True,id=c7944161-7d6c-4fa8-b0b9-a6e2e3c23203,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7944161-7d') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] End _get_guest_xml xml=<domain type="kvm">
Apr 14 13:35:47 user nova-compute[72019]:   <uuid>b64515ec-405b-4d02-9195-3b0efe3b5488</uuid>
Apr 14 13:35:47 user nova-compute[72019]:   <name>instance-0000002e</name>
Apr 14 13:35:47 user nova-compute[72019]:   <memory>196608</memory>
Apr 14 13:35:47 user nova-compute[72019]:   <vcpu>1</vcpu>
Apr 14 13:35:47 user nova-compute[72019]:   <metadata>
Apr 14 13:35:47 user nova-compute[72019]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 13:35:47 user nova-compute[72019]:       <nova:package version="0.0.0"/>
Apr 14 13:35:47 user nova-compute[72019]:       <nova:name>tempest-ServerActionsTestJSON-server-403210657</nova:name>
Apr 14 13:35:47 user nova-compute[72019]:       <nova:creationTime>2023-04-14 13:35:45</nova:creationTime>
Apr 14 13:35:47 user nova-compute[72019]:       <nova:flavor name="m1.micro">
Apr 14 13:35:47 user nova-compute[72019]:         <nova:memory>192</nova:memory>
Apr 14 13:35:47 user nova-compute[72019]:         <nova:disk>1</nova:disk>
Apr 14 13:35:47 user nova-compute[72019]:         <nova:swap>0</nova:swap>
Apr 14 13:35:47 user nova-compute[72019]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 13:35:47 user nova-compute[72019]:         <nova:vcpus>1</nova:vcpus>
Apr 14 13:35:47 user nova-compute[72019]:       </nova:flavor>
Apr 14 13:35:47 user nova-compute[72019]:       <nova:owner>
Apr 14 13:35:47 user nova-compute[72019]:         <nova:user uuid="9169729edbd04fd5a74d2cffd0aa437f">tempest-ServerActionsTestJSON-1929049437-project-member</nova:user>
Apr 14 13:35:47 user nova-compute[72019]:         <nova:project uuid="4b197f1df57f4dee9757639cf861eb97">tempest-ServerActionsTestJSON-1929049437</nova:project>
Apr 14 13:35:47 user nova-compute[72019]:       </nova:owner>
Apr 14 13:35:47 user nova-compute[72019]:       <nova:ports>
Apr 14 13:35:47 user nova-compute[72019]:         <nova:port uuid="c7944161-7d6c-4fa8-b0b9-a6e2e3c23203">
Apr 14 13:35:47 user nova-compute[72019]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 13:35:47 user nova-compute[72019]:         </nova:port>
Apr 14 13:35:47 user nova-compute[72019]:       </nova:ports>
Apr 14 13:35:47 user nova-compute[72019]:     </nova:instance>
Apr 14 13:35:47 user nova-compute[72019]:   </metadata>
Apr 14 13:35:47 user nova-compute[72019]:   <sysinfo type="smbios">
Apr 14 13:35:47 user nova-compute[72019]:     <system>
Apr 14 13:35:47 user nova-compute[72019]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 13:35:47 user nova-compute[72019]:       <entry name="product">OpenStack Nova</entry>
Apr 14 13:35:47 user nova-compute[72019]:       <entry name="version">0.0.0</entry>
Apr 14 13:35:47 user nova-compute[72019]:       <entry name="serial">b64515ec-405b-4d02-9195-3b0efe3b5488</entry>
Apr 14 13:35:47 user nova-compute[72019]:       <entry name="uuid">b64515ec-405b-4d02-9195-3b0efe3b5488</entry>
Apr 14 13:35:47 user nova-compute[72019]:       <entry name="family">Virtual Machine</entry>
Apr 14 13:35:47 user nova-compute[72019]:     </system>
Apr 14 13:35:47 user nova-compute[72019]:   </sysinfo>
Apr 14 13:35:47 user nova-compute[72019]:   <os>
Apr 14 13:35:47 user nova-compute[72019]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 13:35:47 user nova-compute[72019]:     <boot dev="hd"/>
Apr 14 13:35:47 user nova-compute[72019]:     <smbios mode="sysinfo"/>
Apr 14 13:35:47 user nova-compute[72019]:   </os>
Apr 14 13:35:47 user nova-compute[72019]:   <features>
Apr 14 13:35:47 user nova-compute[72019]:     <acpi/>
Apr 14 13:35:47 user nova-compute[72019]:     <apic/>
Apr 14 13:35:47 user nova-compute[72019]:     <vmcoreinfo/>
Apr 14 13:35:47 user nova-compute[72019]:   </features>
Apr 14 13:35:47 user nova-compute[72019]:   <clock offset="utc">
Apr 14 13:35:47 user nova-compute[72019]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 13:35:47 user nova-compute[72019]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 13:35:47 user nova-compute[72019]:     <timer name="hpet" present="no"/>
Apr 14 13:35:47 user nova-compute[72019]:   </clock>
Apr 14 13:35:47 user nova-compute[72019]:   <cpu mode="custom" match="exact">
Apr 14 13:35:47 user nova-compute[72019]:     <model>Nehalem</model>
Apr 14 13:35:47 user nova-compute[72019]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 13:35:47 user nova-compute[72019]:   </cpu>
Apr 14 13:35:47 user nova-compute[72019]:   <devices>
Apr 14 13:35:47 user nova-compute[72019]:     <disk type="block" device="disk">
Apr 14 13:35:47 user nova-compute[72019]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:35:47 user nova-compute[72019]:       <source dev="/dev/sdc"/>
Apr 14 13:35:47 user nova-compute[72019]:       <target dev="vda" bus="virtio"/>
Apr 14 13:35:47 user nova-compute[72019]:       <serial>492fdd47-3fa9-474f-83e3-dfaee2a0c94d</serial>
Apr 14 13:35:47 user nova-compute[72019]:     </disk>
Apr 14 13:35:47 user nova-compute[72019]:     <interface type="ethernet">
Apr 14 13:35:47 user nova-compute[72019]:       <mac address="fa:16:3e:a2:17:55"/>
Apr 14 13:35:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:35:47 user nova-compute[72019]:       <mtu size="1442"/>
Apr 14 13:35:47 user nova-compute[72019]:       <target dev="tapc7944161-7d"/>
Apr 14 13:35:47 user nova-compute[72019]:     </interface>
Apr 14 13:35:47 user nova-compute[72019]:     <serial type="pty">
Apr 14 13:35:47 user nova-compute[72019]:       <log file="/opt/stack/data/nova/instances/b64515ec-405b-4d02-9195-3b0efe3b5488/console.log" append="off"/>
Apr 14 13:35:47 user nova-compute[72019]:     </serial>
Apr 14 13:35:47 user nova-compute[72019]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 13:35:47 user nova-compute[72019]:     <video>
Apr 14 13:35:47 user nova-compute[72019]:       <model type="virtio"/>
Apr 14 13:35:47 user nova-compute[72019]:     </video>
Apr 14 13:35:47 user nova-compute[72019]:     <rng model="virtio">
Apr 14 13:35:47 user nova-compute[72019]:       <backend model="random">/dev/urandom</backend>
Apr 14 13:35:47 user nova-compute[72019]:     </rng>
Apr 14 13:35:47 user nova-compute[72019]:     <controller type="usb" index="0" model="none"/>
Apr 14 13:35:47 user nova-compute[72019]:     <memballoon model="virtio">
Apr 14 13:35:47 user nova-compute[72019]:       <stats period="10"/>
Apr 14 13:35:47 user nova-compute[72019]:     </memballoon>
Apr 14 13:35:47 user nova-compute[72019]:   </devices>
Apr 14 13:35:47 user nova-compute[72019]: </domain>
Apr 14 13:35:47 user nova-compute[72019]:  {{(pid=72019) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-403210657',display_name='tempest-ServerActionsTestJSON-server-403210657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-403210657',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:33:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-olbsjqoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:35:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=b64515ec-405b-4d02-9195-3b0efe3b5488,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1832265350-network", "vif_mac": "fa:16:3e:a2:17:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1832265350-network", "vif_mac": "fa:16:3e:a2:17:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:17:55,bridge_name='br-int',has_traffic_filtering=True,id=c7944161-7d6c-4fa8-b0b9-a6e2e3c23203,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7944161-7d') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG os_vif [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:17:55,bridge_name='br-int',has_traffic_filtering=True,id=c7944161-7d6c-4fa8-b0b9-a6e2e3c23203,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7944161-7d') {{(pid=72019) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7944161-7d, may_exist=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7944161-7d, col_values=(('external_ids', {'iface-id': 'c7944161-7d6c-4fa8-b0b9-a6e2e3c23203', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:17:55', 'vm-uuid': 'b64515ec-405b-4d02-9195-3b0efe3b5488'}),)) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:47 user nova-compute[72019]: INFO os_vif [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:17:55,bridge_name='br-int',has_traffic_filtering=True,id=c7944161-7d6c-4fa8-b0b9-a6e2e3c23203,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7944161-7d')
Apr 14 13:35:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] No VIF found with MAC fa:16:3e:a2:17:55, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:47 user nova-compute[72019]: INFO nova.compute.manager [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Detaching volume ceb34956-9137-4101-bf06-c0a761320578
Apr 14 13:35:47 user nova-compute[72019]: INFO nova.virt.block_device [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Attempting to driver detach volume ceb34956-9137-4101-bf06-c0a761320578 from mountpoint /dev/vdb
Apr 14 13:35:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Attempting to detach device vdb from instance 03b76423-23ff-4721-8300-b198286c109a from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:35:47 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:35:47 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:35:47 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:35:47 user nova-compute[72019]:   <serial>ceb34956-9137-4101-bf06-c0a761320578</serial>
Apr 14 13:35:47 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:35:47 user nova-compute[72019]: </disk>
Apr 14 13:35:47 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:35:47 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Successfully detached device vdb from instance 03b76423-23ff-4721-8300-b198286c109a from the persistent domain config.
Apr 14 13:35:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03b76423-23ff-4721-8300-b198286c109a from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:35:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:35:47 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:35:47 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:35:47 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:35:47 user nova-compute[72019]:   <serial>ceb34956-9137-4101-bf06-c0a761320578</serial>
Apr 14 13:35:47 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:35:47 user nova-compute[72019]: </disk>
Apr 14 13:35:47 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681479348.3031902, 03b76423-23ff-4721-8300-b198286c109a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:35:48 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Successfully detached device vdb from instance 03b76423-23ff-4721-8300-b198286c109a from the live domain config.
Apr 14 13:35:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnIhVUlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:35:48 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd723192-4dc1-444c-a14f-647c72c8ac7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:35:48 user nova-compute[72019]: No targets found.
Apr 14 13:35:48 user nova-compute[72019]: iSNS:
Apr 14 13:35:48 user nova-compute[72019]: No targets found.
Apr 14 13:35:48 user nova-compute[72019]: STATIC:
Apr 14 13:35:48 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d
Apr 14 13:35:48 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:35:48 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:35:48 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4
Apr 14 13:35:48 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:35:48 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:35:48 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578
Apr 14 13:35:48 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:35:48 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:35:48 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df
Apr 14 13:35:48 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:35:48 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:35:48 user nova-compute[72019]: FIRMWARE:
Apr 14 13:35:48 user nova-compute[72019]: No targets found.
Apr 14 13:35:48 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:35:48 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:35:48 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fce4b2d-ff70-4d2b-9ee2-ede5d0a8126f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[09933fc8-96a9-4750-8634-24682a43774e]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:35:48 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:35:48 user nova-compute[72019]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 (non-flash)
Apr 14 13:35:48 user nova-compute[72019]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:35:48 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:35:48 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:35:48 user nova-compute[72019]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 (non-flash)
Apr 14 13:35:48 user nova-compute[72019]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:35:48 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74646a3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578'): ({'sdb'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Removing single pathed devices sdb {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[752fcc2a-efe1-483e-9b4e-84a774688b27]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ee2cd0-f5a9-4df9-81bc-3f5102090a8f]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Flushing IO for device /dev/sdb {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ea91db-249b-4369-84e2-7c5588abe029]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[587c5bed-2284-4551-959e-8cb41bc4fba3]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4687276c-f0f2-42a8-b7dd-b4e8d0579558]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ca1c30-674e-4295-acd3-79b0551a75b0]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578, portal: 172.16.0.220,3260]
Apr 14 13:35:48 user nova-compute[72019]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578, portal: 172.16.0.220,3260] successful.
Apr 14 13:35:48 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ceb34956-9137-4101-bf06-c0a761320578 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa50bc56-622c-4f20-8eb7-577db0868cee]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] <== disconnect_volume: return (318ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-bb0957cf-24bc-428b-82e6-77dc3e39cbda req-75a3d944-7d66-4cd6-a7ea-1c36997628dc service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received event network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:35:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-bb0957cf-24bc-428b-82e6-77dc3e39cbda req-75a3d944-7d66-4cd6-a7ea-1c36997628dc service nova] Acquiring lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-bb0957cf-24bc-428b-82e6-77dc3e39cbda req-75a3d944-7d66-4cd6-a7ea-1c36997628dc service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-bb0957cf-24bc-428b-82e6-77dc3e39cbda req-75a3d944-7d66-4cd6-a7ea-1c36997628dc service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:49 user nova-compute[72019]: DEBUG nova.compute.manager [req-bb0957cf-24bc-428b-82e6-77dc3e39cbda req-75a3d944-7d66-4cd6-a7ea-1c36997628dc service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] No waiting events found dispatching network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:35:49 user nova-compute[72019]: WARNING nova.compute.manager [req-bb0957cf-24bc-428b-82e6-77dc3e39cbda req-75a3d944-7d66-4cd6-a7ea-1c36997628dc service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received unexpected event network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance with vm_state active and task_state resize_finish.
Apr 14 13:35:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:49 user nova-compute[72019]: DEBUG nova.objects.instance [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'flavor' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:35:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.915s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.host [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Removed pending event for b64515ec-405b-4d02-9195-3b0efe3b5488 due to event {{(pid=72019) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 13:35:51 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479351.0294154, b64515ec-405b-4d02-9195-3b0efe3b5488 => Resumed> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:35:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] VM Resumed (Lifecycle Event)
Apr 14 13:35:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Instance event wait completed in 0 seconds for  {{(pid=72019) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 13:35:51 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Instance running successfully.
Apr 14 13:35:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Failed to set time: agent not configured {{(pid=72019) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 13:35:51 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] finish_migration finished successfully. {{(pid=72019) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 13:35:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:35:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:35:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 13:35:51 user nova-compute[72019]: DEBUG nova.virt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Emitting event <LifecycleEvent: 1681479351.033216, b64515ec-405b-4d02-9195-3b0efe3b5488 => Started> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:35:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] VM Started (Lifecycle Event)
Apr 14 13:35:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:35:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72019) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 13:35:51 user nova-compute[72019]: INFO nova.compute.manager [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 13:35:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-03bf8313-8348-4bd2-9bcf-194266c9d18c req-c2838ece-ed90-4a46-99b2-085e51a36098 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received event network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:35:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-03bf8313-8348-4bd2-9bcf-194266c9d18c req-c2838ece-ed90-4a46-99b2-085e51a36098 service nova] Acquiring lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:35:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-03bf8313-8348-4bd2-9bcf-194266c9d18c req-c2838ece-ed90-4a46-99b2-085e51a36098 service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:35:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-03bf8313-8348-4bd2-9bcf-194266c9d18c req-c2838ece-ed90-4a46-99b2-085e51a36098 service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:35:51 user nova-compute[72019]: DEBUG nova.compute.manager [req-03bf8313-8348-4bd2-9bcf-194266c9d18c req-c2838ece-ed90-4a46-99b2-085e51a36098 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] No waiting events found dispatching network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:35:51 user nova-compute[72019]: WARNING nova.compute.manager [req-03bf8313-8348-4bd2-9bcf-194266c9d18c req-c2838ece-ed90-4a46-99b2-085e51a36098 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received unexpected event network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance with vm_state resized and task_state None.
Apr 14 13:35:51 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479336.433185, b7cdf352-a517-4296-bc70-400836915095 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:35:51 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: b7cdf352-a517-4296-bc70-400836915095] VM Stopped (Lifecycle Event)
Apr 14 13:35:51 user nova-compute[72019]: DEBUG nova.compute.manager [None req-f41899bd-2595-44f8-aaa6-eb569d0d4974 None None] [instance: b7cdf352-a517-4296-bc70-400836915095] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:35:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:35:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:02 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:36:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:36:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:36:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:36:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:36:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-0640279d-ef33-4c23-b3c4-b399803297ca req-14e1fbad-d656-4516-a494-48256644b216 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Received event network-changed-efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:36:24 user nova-compute[72019]: DEBUG nova.compute.manager [req-0640279d-ef33-4c23-b3c4-b399803297ca req-14e1fbad-d656-4516-a494-48256644b216 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Refreshing instance network info cache due to event network-changed-efa8cf9b-10fd-48d5-a01d-160cb930bc07. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:36:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0640279d-ef33-4c23-b3c4-b399803297ca req-14e1fbad-d656-4516-a494-48256644b216 service nova] Acquiring lock "refresh_cache-5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:36:24 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0640279d-ef33-4c23-b3c4-b399803297ca req-14e1fbad-d656-4516-a494-48256644b216 service nova] Acquired lock "refresh_cache-5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:36:24 user nova-compute[72019]: DEBUG nova.network.neutron [req-0640279d-ef33-4c23-b3c4-b399803297ca req-14e1fbad-d656-4516-a494-48256644b216 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Refreshing network info cache for port efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG nova.network.neutron [req-0640279d-ef33-4c23-b3c4-b399803297ca req-14e1fbad-d656-4516-a494-48256644b216 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Updated VIF entry in instance network info cache for port efa8cf9b-10fd-48d5-a01d-160cb930bc07. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG nova.network.neutron [req-0640279d-ef33-4c23-b3c4-b399803297ca req-14e1fbad-d656-4516-a494-48256644b216 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Updating instance_info_cache with network_info: [{"id": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "address": "fa:16:3e:90:5e:ee", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa8cf9b-10", "ovs_interfaceid": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0640279d-ef33-4c23-b3c4-b399803297ca req-14e1fbad-d656-4516-a494-48256644b216 service nova] Releasing lock "refresh_cache-5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-633efae9-614a-4f3e-b729-d6f98a4427a6 req-fa90f096-9f4c-4682-81d4-38f4cb6bdf64 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Received event network-changed-efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-633efae9-614a-4f3e-b729-d6f98a4427a6 req-fa90f096-9f4c-4682-81d4-38f4cb6bdf64 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Refreshing instance network info cache due to event network-changed-efa8cf9b-10fd-48d5-a01d-160cb930bc07. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-633efae9-614a-4f3e-b729-d6f98a4427a6 req-fa90f096-9f4c-4682-81d4-38f4cb6bdf64 service nova] Acquiring lock "refresh_cache-5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-633efae9-614a-4f3e-b729-d6f98a4427a6 req-fa90f096-9f4c-4682-81d4-38f4cb6bdf64 service nova] Acquired lock "refresh_cache-5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG nova.network.neutron [req-633efae9-614a-4f3e-b729-d6f98a4427a6 req-fa90f096-9f4c-4682-81d4-38f4cb6bdf64 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Refreshing network info cache for port efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:25 user nova-compute[72019]: INFO nova.compute.manager [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Terminating instance
Apr 14 13:36:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.network.neutron [req-633efae9-614a-4f3e-b729-d6f98a4427a6 req-fa90f096-9f4c-4682-81d4-38f4cb6bdf64 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Updated VIF entry in instance network info cache for port efa8cf9b-10fd-48d5-a01d-160cb930bc07. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.network.neutron [req-633efae9-614a-4f3e-b729-d6f98a4427a6 req-fa90f096-9f4c-4682-81d4-38f4cb6bdf64 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Updating instance_info_cache with network_info: [{"id": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "address": "fa:16:3e:90:5e:ee", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa8cf9b-10", "ovs_interfaceid": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-633efae9-614a-4f3e-b729-d6f98a4427a6 req-fa90f096-9f4c-4682-81d4-38f4cb6bdf64 service nova] Releasing lock "refresh_cache-5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:36:26 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Instance destroyed successfully.
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lazy-loading 'resources' on Instance uuid 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1569614272',display_name='tempest-TestVolumeBootPattern-server-1569614272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1569614272',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn0p0IUuVWoQy0dGsU9Pfuky6ks2ZRYQtS2s2AMQUPgWS/ZFj3/9xG//6C/vHeESCtbDFovyBlscNk5g1knYdZi4/iSS7XffFRPqq5TMnScynxdTnC9z463yGcQBrDWEQ==',key_name='tempest-TestVolumeBootPattern-212867192',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-tc2fnsrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:34:50Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "address": "fa:16:3e:90:5e:ee", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa8cf9b-10", "ovs_interfaceid": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "address": "fa:16:3e:90:5e:ee", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa8cf9b-10", "ovs_interfaceid": "efa8cf9b-10fd-48d5-a01d-160cb930bc07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:5e:ee,bridge_name='br-int',has_traffic_filtering=True,id=efa8cf9b-10fd-48d5-a01d-160cb930bc07,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa8cf9b-10') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_vif [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:5e:ee,bridge_name='br-int',has_traffic_filtering=True,id=efa8cf9b-10fd-48d5-a01d-160cb930bc07,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa8cf9b-10') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefa8cf9b-10, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:36:26 user nova-compute[72019]: INFO os_vif [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:5e:ee,bridge_name='br-int',has_traffic_filtering=True,id=efa8cf9b-10fd-48d5-a01d-160cb930bc07,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa8cf9b-10')
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLXVUJim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:36:26 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "978f6fc8-1080-4840-ab8a-e025efe4f906" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:26 user nova-compute[72019]: INFO nova.compute.manager [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Terminating instance
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3816e43-b6e0-4bf4-bc3c-30efc26497d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.compute.manager [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:36:26 user nova-compute[72019]: No targets found.
Apr 14 13:36:26 user nova-compute[72019]: iSNS:
Apr 14 13:36:26 user nova-compute[72019]: No targets found.
Apr 14 13:36:26 user nova-compute[72019]: STATIC:
Apr 14 13:36:26 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d
Apr 14 13:36:26 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:36:26 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:36:26 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4
Apr 14 13:36:26 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:36:26 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:36:26 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df
Apr 14 13:36:26 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:36:26 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:36:26 user nova-compute[72019]: FIRMWARE:
Apr 14 13:36:26 user nova-compute[72019]: No targets found.
Apr 14 13:36:26 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:36:26 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:36:26 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b92c4f-244e-4d9e-ba54-f116f3479027]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd99d6f-ee45-49ca-b39b-8a5447242796]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:36:26 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:36:26 user nova-compute[72019]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:36:26 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:36:26 user nova-compute[72019]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df (non-flash)
Apr 14 13:36:26 user nova-compute[72019]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:36:26 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74907793f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df'): ({'sdf'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Removing single pathed devices sdf {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6333ecb5-ab70-4b0f-a985-aeb3669bd0a4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db18b79-1b0c-4172-97ec-4366790cd18f]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flushing IO for device /dev/sdf {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[04759bb3-738a-42ab-8a93-e46b671130ff]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Received event network-vif-unplugged-efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] Acquiring lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] Lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] Lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] No waiting events found dispatching network-vif-unplugged-efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Received event network-vif-unplugged-efa8cf9b-10fd-48d5-a01d-160cb930bc07 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Received event network-vif-plugged-efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] Acquiring lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] Lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] Lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] No waiting events found dispatching network-vif-plugged-efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:36:26 user nova-compute[72019]: WARNING nova.compute.manager [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Received unexpected event network-vif-plugged-efa8cf9b-10fd-48d5-a01d-160cb930bc07 for instance with vm_state active and task_state deleting.
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1293c2-195f-4e73-a07c-cc6f76132911]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] SCSI volumes sdf have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26438626566613533', '/dev/disk/by-id/scsi-1SCST_BIO67ede1b7-d8befa531165ac1d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_67ede1b7') {{(pid=82397) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 13:36:26 user nova-compute[72019]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26438626566613533
Apr 14 13:36:26 user nova-compute[72019]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO67ede1b7-d8befa531165ac1d
Apr 14 13:36:26 user nova-compute[72019]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_67ede1b7
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e65faf-d998-4766-97b6-e843ddf8cb21]: (4, None) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c7b8c5-5488-4c11-a495-d614aa54dbef]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[48296fbe-79b9-4b85-b6a6-9b169d865c6f]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df, portal: 172.16.0.220,3260]
Apr 14 13:36:26 user nova-compute[72019]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df, portal: 172.16.0.220,3260] successful.
Apr 14 13:36:26 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa139a63-05a5-4336-97a0-e22d07bcd8df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c777735-b3b9-471b-bf8e-9f73bcb03697]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== disconnect_volume: return (352ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:36:26 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Deleting instance files /opt/stack/data/nova/instances/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1_del
Apr 14 13:36:26 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Deletion of /opt/stack/data/nova/instances/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1_del complete
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-5ef8e3af-4ed0-4db8-84d2-449f70dda7a7 req-7de94f2f-35ea-47ce-af8b-8115ff2bdc45 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Received event network-vif-unplugged-4c6952bc-e57c-4679-90f3-e9bd66e864ca {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5ef8e3af-4ed0-4db8-84d2-449f70dda7a7 req-7de94f2f-35ea-47ce-af8b-8115ff2bdc45 service nova] Acquiring lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5ef8e3af-4ed0-4db8-84d2-449f70dda7a7 req-7de94f2f-35ea-47ce-af8b-8115ff2bdc45 service nova] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-5ef8e3af-4ed0-4db8-84d2-449f70dda7a7 req-7de94f2f-35ea-47ce-af8b-8115ff2bdc45 service nova] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-5ef8e3af-4ed0-4db8-84d2-449f70dda7a7 req-7de94f2f-35ea-47ce-af8b-8115ff2bdc45 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] No waiting events found dispatching network-vif-unplugged-4c6952bc-e57c-4679-90f3-e9bd66e864ca {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.compute.manager [req-5ef8e3af-4ed0-4db8-84d2-449f70dda7a7 req-7de94f2f-35ea-47ce-af8b-8115ff2bdc45 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Received event network-vif-unplugged-4c6952bc-e57c-4679-90f3-e9bd66e864ca for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:36:26 user nova-compute[72019]: INFO nova.compute.manager [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Took 1.27 seconds to destroy the instance on the hypervisor.
Apr 14 13:36:26 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:36:26 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Instance destroyed successfully.
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.objects.instance [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'resources' on Instance uuid 978f6fc8-1080-4840-ab8a-e025efe4f906 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1191459632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1191459632',id=19,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a573d19b775642bba2f2883e0005492d',ramdisk_id='',reservation_id='r-7i0o2yys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-740277424',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:18:44Z,user_data=None,user_id='ebc2d46bc1794568841df20b046356c7',uuid=978f6fc8-1080-4840-ab8a-e025efe4f906,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "address": "fa:16:3e:7a:a4:82", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6952bc-e5", "ovs_interfaceid": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converting VIF {"id": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "address": "fa:16:3e:7a:a4:82", "network": {"id": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-755694922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a573d19b775642bba2f2883e0005492d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6952bc-e5", "ovs_interfaceid": "4c6952bc-e57c-4679-90f3-e9bd66e864ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:a4:82,bridge_name='br-int',has_traffic_filtering=True,id=4c6952bc-e57c-4679-90f3-e9bd66e864ca,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6952bc-e5') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG os_vif [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:a4:82,bridge_name='br-int',has_traffic_filtering=True,id=4c6952bc-e57c-4679-90f3-e9bd66e864ca,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6952bc-e5') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c6952bc-e5, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:26 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:36:26 user nova-compute[72019]: INFO os_vif [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:a4:82,bridge_name='br-int',has_traffic_filtering=True,id=4c6952bc-e57c-4679-90f3-e9bd66e864ca,network=Network(5bb34665-b8a7-4eb1-a250-c5b7ca33f499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6952bc-e5')
Apr 14 13:36:26 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Deleting instance files /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906_del
Apr 14 13:36:27 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Deletion of /opt/stack/data/nova/instances/978f6fc8-1080-4840-ab8a-e025efe4f906_del complete
Apr 14 13:36:27 user nova-compute[72019]: INFO nova.compute.manager [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 14 13:36:27 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:36:27 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:36:27 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:36:27 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:36:27 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Took 0.56 seconds to deallocate network for instance.
Apr 14 13:36:27 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:36:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:27 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Took 0.47 seconds to deallocate network for instance.
Apr 14 13:36:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:27 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:36:27 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:36:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:27 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Deleted allocations for instance 978f6fc8-1080-4840-ab8a-e025efe4f906
Apr 14 13:36:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.622s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:28 user nova-compute[72019]: INFO nova.compute.manager [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Took 0.84 seconds to detach 1 volumes for instance.
Apr 14 13:36:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:28 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:36:28 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:36:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:28 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Deleted allocations for instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1
Apr 14 13:36:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.079s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-24b64361-60ad-465a-995d-ac194c3e0af8 req-21142ea9-72b8-41e6-9957-fdf40d454f9f service nova] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Received event network-vif-deleted-efa8cf9b-10fd-48d5-a01d-160cb930bc07 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:36:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-2775548d-07b1-4eb6-8d9c-89576296c7c6 req-83d86211-e8c6-48e6-aa11-bdba1df113a7 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Received event network-vif-plugged-4c6952bc-e57c-4679-90f3-e9bd66e864ca {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:36:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2775548d-07b1-4eb6-8d9c-89576296c7c6 req-83d86211-e8c6-48e6-aa11-bdba1df113a7 service nova] Acquiring lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2775548d-07b1-4eb6-8d9c-89576296c7c6 req-83d86211-e8c6-48e6-aa11-bdba1df113a7 service nova] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:28 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2775548d-07b1-4eb6-8d9c-89576296c7c6 req-83d86211-e8c6-48e6-aa11-bdba1df113a7 service nova] Lock "978f6fc8-1080-4840-ab8a-e025efe4f906-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-2775548d-07b1-4eb6-8d9c-89576296c7c6 req-83d86211-e8c6-48e6-aa11-bdba1df113a7 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] No waiting events found dispatching network-vif-plugged-4c6952bc-e57c-4679-90f3-e9bd66e864ca {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:36:28 user nova-compute[72019]: WARNING nova.compute.manager [req-2775548d-07b1-4eb6-8d9c-89576296c7c6 req-83d86211-e8c6-48e6-aa11-bdba1df113a7 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Received unexpected event network-vif-plugged-4c6952bc-e57c-4679-90f3-e9bd66e864ca for instance with vm_state deleted and task_state None.
Apr 14 13:36:28 user nova-compute[72019]: DEBUG nova.compute.manager [req-2775548d-07b1-4eb6-8d9c-89576296c7c6 req-83d86211-e8c6-48e6-aa11-bdba1df113a7 service nova] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Received event network-vif-deleted-4c6952bc-e57c-4679-90f3-e9bd66e864ca {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:36:29 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:36:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:36:31 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:32 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:36:36 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:37 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:36:37 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:36:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:36:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:36:37 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:36:38 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updating instance_info_cache with network_info: [{"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:36:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:36:38 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:36:38 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:36:40 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:36:40 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:36:40 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:36:40 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:36:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:40 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:36:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:40 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479386.3098645, 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:36:41 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] VM Stopped (Lifecycle Event)
Apr 14 13:36:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-81a0f3db-ef57-4b2d-a424-f47d9e7a61be None None] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:41 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:36:41 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=8368MB free_disk=26.105064392089844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.objects.instance [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'flavor' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Applying migration context for instance b64515ec-405b-4d02-9195-3b0efe3b5488 as it has an incoming, in-progress migration b150cbf6-bc86-40a2-9abf-676cf70f390c. Migration status is finished {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 13:36:41 user nova-compute[72019]: INFO nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updating resource usage from migration b150cbf6-bc86-40a2-9abf-676cf70f390c
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 03b76423-23ff-4721-8300-b198286c109a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance fe769254-aa7a-4038-abb6-18628dbcd227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 5f323dce-be29-4437-8992-4bfec3ba29ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Migration b150cbf6-bc86-40a2-9abf-676cf70f390c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b64515ec-405b-4d02-9195-3b0efe3b5488 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479386.9559665, 978f6fc8-1080-4840-ab8a-e025efe4f906 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:36:41 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] VM Stopped (Lifecycle Event)
Apr 14 13:36:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:41 user nova-compute[72019]: INFO nova.compute.manager [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Attaching volume e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 to /dev/vdb
Apr 14 13:36:41 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-615da635-e251-4bcb-9bfb-56a64a1f7438 None None] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG os_brick.utils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fb1386-196e-4e52-92dd-a7ef891a96e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c61e0b2c51a\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafb0aad-dfd6-4e1f-b840-aa7b33cfdbe6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32a8900-74ee-4247-af5c-2dcac7da1894]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fec2918-977c-48a4-8af0-b5b559c0bdf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Running cmd (subprocess): nvme version {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 'nvme version' failed. Not Retrying. {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] nvme not present on system {{(pid=72019) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 13:36:42 user nova-compute[72019]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 13:36:42 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[79026602-dd2a-46af-8d35-c2cfd1106f5e]: (4, '') {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72019) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.lightos [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] LIGHTOS: no hostnqn found. {{(pid=72019) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG os_brick.utils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c61e0b2c51a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG nova.virt.block_device [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Updating existing volume attachment record: 31a3cc69-ba5f-44a1-88f5-7f6825e27ded {{(pid=72019) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 13:36:42 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:45 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Calling os-brick to attach iSCSI Volume {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZjNzVun', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:36:46 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:36:46 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:36:46 user nova-compute[72019]: INFO os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4cbba2-dbee-40d1-a80f-6688235a0b31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 13:36:46 user nova-compute[72019]:  {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4c5608-1b17-410a-84b0-980da654c634]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3] added\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3] added
Apr 14 13:36:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44709d6-c5df-49ca-9f84-c3ca8da725c2]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f32786-7348-4ab6-b374-a69ec81f0231]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZjNzVun {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZjNzVun" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea480ff-35b3-4136-9216-a644a47e3958]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tZjNzVun'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac9539c-85c9-4aa8-9e57-af823a0c8a63]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c44501d-692f-40fa-bab3-d8ca95ce45f7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:36:46 user nova-compute[72019]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:36:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:36:46 user nova-compute[72019]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:36:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --login {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e992de5-41d4-4b29-9a1b-fb68bd0cd79b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3, portal: 172.16.0.220,3260]
Apr 14 13:36:46 user nova-compute[72019]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3, portal: 172.16.0.220,3260] successful.
Apr 14 13:36:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db34a5a-713e-4e30-a9f7-a1badc1139ea]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f04721-ac7b-4098-ab4e-d3bd96ffe0f7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:36:46 user nova-compute[72019]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:36:46 user nova-compute[72019]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 (non-flash)
Apr 14 13:36:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:36:46 user nova-compute[72019]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:36:46 user nova-compute[72019]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 (non-flash)
Apr 14 13:36:46 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Connected to 172.16.0.220:3260 {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72019) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72019) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[20443d72-8cff-4bbd-9031-4832bedec0ae]: (4, ('- - 0', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:36:46 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:47 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:47 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72019) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 13:36:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZjNzVun', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=72019) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 13:36:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:36:47 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23533373038663865', 'path': '/dev/sdb'} {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:36:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533373038663865', 'path': '/dev/sdb'} {{(pid=72019) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 13:36:47 user nova-compute[72019]: DEBUG nova.objects.instance [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'flavor' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:36:47 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 13:36:47 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:36:47 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:36:47 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:36:47 user nova-compute[72019]:   <serial>e8dba21f-cb8b-4d26-9fef-9c1ee116acf3</serial>
Apr 14 13:36:47 user nova-compute[72019]: </disk>
Apr 14 13:36:47 user nova-compute[72019]:  {{(pid=72019) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 13:36:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] No BDM found with device name vda, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:36:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72019) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 13:36:48 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] No VIF found with MAC fa:16:3e:3e:80:6a, not building metadata {{(pid=72019) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 13:36:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.584s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:36:50 user nova-compute[72019]: INFO nova.compute.manager [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Detaching volume e8dba21f-cb8b-4d26-9fef-9c1ee116acf3
Apr 14 13:36:50 user nova-compute[72019]: INFO nova.virt.block_device [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Attempting to driver detach volume e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 from mountpoint /dev/vdb
Apr 14 13:36:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Attempting to detach device vdb from instance 03b76423-23ff-4721-8300-b198286c109a from the persistent domain config. {{(pid=72019) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:36:50 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:36:50 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:36:50 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:36:50 user nova-compute[72019]:   <serial>e8dba21f-cb8b-4d26-9fef-9c1ee116acf3</serial>
Apr 14 13:36:50 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:36:50 user nova-compute[72019]: </disk>
Apr 14 13:36:50 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:36:50 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Successfully detached device vdb from instance 03b76423-23ff-4721-8300-b198286c109a from the persistent domain config.
Apr 14 13:36:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03b76423-23ff-4721-8300-b198286c109a from the live domain config. {{(pid=72019) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.guest [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 13:36:50 user nova-compute[72019]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 13:36:50 user nova-compute[72019]:   <source dev="/dev/sdb"/>
Apr 14 13:36:50 user nova-compute[72019]:   <target dev="vdb" bus="virtio"/>
Apr 14 13:36:50 user nova-compute[72019]:   <serial>e8dba21f-cb8b-4d26-9fef-9c1ee116acf3</serial>
Apr 14 13:36:50 user nova-compute[72019]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 13:36:50 user nova-compute[72019]: </disk>
Apr 14 13:36:50 user nova-compute[72019]:  {{(pid=72019) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-6ead9936-5ceb-4fda-80c2-df37fcc9aee4 None None] Received event <DeviceRemovedEvent: 1681479410.5933712, 03b76423-23ff-4721-8300-b198286c109a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72019) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 13:36:50 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Successfully detached device vdb from instance 03b76423-23ff-4721-8300-b198286c109a from the live domain config.
Apr 14 13:36:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZjNzVun', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:36:50 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[347f2831-2c42-4405-a549-b9dcafd17929]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:36:50 user nova-compute[72019]: No targets found.
Apr 14 13:36:50 user nova-compute[72019]: iSNS:
Apr 14 13:36:50 user nova-compute[72019]: No targets found.
Apr 14 13:36:50 user nova-compute[72019]: STATIC:
Apr 14 13:36:50 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d
Apr 14 13:36:50 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:36:50 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:36:50 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4
Apr 14 13:36:50 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:36:50 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:36:50 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3
Apr 14 13:36:50 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:36:50 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:36:50 user nova-compute[72019]: FIRMWARE:
Apr 14 13:36:50 user nova-compute[72019]: No targets found.
Apr 14 13:36:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:36:50 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:36:50 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[160a91f9-dc5e-4ea9-bdc8-bd771b7537cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfb4968-3829-4377-a49e-d307bd7cef83]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:36:50 user nova-compute[72019]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:36:50 user nova-compute[72019]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 (non-flash)
Apr 14 13:36:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:36:50 user nova-compute[72019]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:36:50 user nova-compute[72019]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 (non-flash)
Apr 14 13:36:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f746466e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3'): ({'sdb'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Removing single pathed devices sdb {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[159bd3c9-2ce6-4c36-809f-857bab5e6fd3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5d2c8d-56d3-475d-a348-2c420ef60255]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Flushing IO for device /dev/sdb {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aff7e7f-1083-42e1-b2ad-89e7b7a783bc]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbe19e2-5061-4785-a11f-0bd37d8e12ea]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] SCSI volumes sdb have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd19f37-1eae-47ca-b138-26bcdb519895]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[add16f37-cd50-4bcc-af47-ad890f743de9]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3, portal: 172.16.0.220,3260]
Apr 14 13:36:50 user nova-compute[72019]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3, portal: 172.16.0.220,3260] successful.
Apr 14 13:36:50 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d544dab-ffae-460b-b80e-434ce01414e8]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] <== disconnect_volume: return (335ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:36:50 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:36:51 user nova-compute[72019]: DEBUG nova.objects.instance [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'flavor' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:36:51 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.742s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:36:51 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:36:56 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:37:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:37:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:37:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:37:01 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:07 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-40e69342-0a3c-4d6e-bb32-1c7775168bc6 req-b0cd60ba-92e9-44b2-ab39-939c97ddbcf9 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Received event network-changed-a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG nova.compute.manager [req-40e69342-0a3c-4d6e-bb32-1c7775168bc6 req-b0cd60ba-92e9-44b2-ab39-939c97ddbcf9 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Refreshing instance network info cache due to event network-changed-a23e9593-5778-4287-890a-07585622bc27. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-40e69342-0a3c-4d6e-bb32-1c7775168bc6 req-b0cd60ba-92e9-44b2-ab39-939c97ddbcf9 service nova] Acquiring lock "refresh_cache-5f323dce-be29-4437-8992-4bfec3ba29ab" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-40e69342-0a3c-4d6e-bb32-1c7775168bc6 req-b0cd60ba-92e9-44b2-ab39-939c97ddbcf9 service nova] Acquired lock "refresh_cache-5f323dce-be29-4437-8992-4bfec3ba29ab" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG nova.network.neutron [req-40e69342-0a3c-4d6e-bb32-1c7775168bc6 req-b0cd60ba-92e9-44b2-ab39-939c97ddbcf9 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Refreshing network info cache for port a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "5f323dce-be29-4437-8992-4bfec3ba29ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "5f323dce-be29-4437-8992-4bfec3ba29ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:37:23 user nova-compute[72019]: INFO nova.compute.manager [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Terminating instance
Apr 14 13:37:23 user nova-compute[72019]: DEBUG nova.compute.manager [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG nova.network.neutron [req-40e69342-0a3c-4d6e-bb32-1c7775168bc6 req-b0cd60ba-92e9-44b2-ab39-939c97ddbcf9 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Updated VIF entry in instance network info cache for port a23e9593-5778-4287-890a-07585622bc27. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG nova.network.neutron [req-40e69342-0a3c-4d6e-bb32-1c7775168bc6 req-b0cd60ba-92e9-44b2-ab39-939c97ddbcf9 service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Updating instance_info_cache with network_info: [{"id": "a23e9593-5778-4287-890a-07585622bc27", "address": "fa:16:3e:c5:57:b3", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e9593-57", "ovs_interfaceid": "a23e9593-5778-4287-890a-07585622bc27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:37:23 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-40e69342-0a3c-4d6e-bb32-1c7775168bc6 req-b0cd60ba-92e9-44b2-ab39-939c97ddbcf9 service nova] Releasing lock "refresh_cache-5f323dce-be29-4437-8992-4bfec3ba29ab" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:37:24 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Instance destroyed successfully.
Apr 14 13:37:24 user nova-compute[72019]: DEBUG nova.objects.instance [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lazy-loading 'resources' on Instance uuid 5f323dce-be29-4437-8992-4bfec3ba29ab {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1586008634',display_name='tempest-TestVolumeBootPattern-server-1586008634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1586008634',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn0p0IUuVWoQy0dGsU9Pfuky6ks2ZRYQtS2s2AMQUPgWS/ZFj3/9xG//6C/vHeESCtbDFovyBlscNk5g1knYdZi4/iSS7XffFRPqq5TMnScynxdTnC9z463yGcQBrDWEQ==',key_name='tempest-TestVolumeBootPattern-212867192',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:32:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='818de6fa330c4c87a3b6228345d9f13a',ramdisk_id='',reservation_id='r-h91zctcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1645546988',owner_user_name='tempest-TestVolumeBootPattern-1645546988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:32:43Z,user_data=None,user_id='bb40413bd0c3490d97b997f69c930f72',uuid=5f323dce-be29-4437-8992-4bfec3ba29ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a23e9593-5778-4287-890a-07585622bc27", "address": "fa:16:3e:c5:57:b3", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e9593-57", "ovs_interfaceid": "a23e9593-5778-4287-890a-07585622bc27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converting VIF {"id": "a23e9593-5778-4287-890a-07585622bc27", "address": "fa:16:3e:c5:57:b3", "network": {"id": "32e04661-5709-44d8-b16f-bc45b62317fc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1884396529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818de6fa330c4c87a3b6228345d9f13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e9593-57", "ovs_interfaceid": "a23e9593-5778-4287-890a-07585622bc27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:57:b3,bridge_name='br-int',has_traffic_filtering=True,id=a23e9593-5778-4287-890a-07585622bc27,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e9593-57') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_vif [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:57:b3,bridge_name='br-int',has_traffic_filtering=True,id=a23e9593-5778-4287-890a-07585622bc27,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e9593-57') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa23e9593-57, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:24 user nova-compute[72019]: INFO os_vif [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:57:b3,bridge_name='br-int',has_traffic_filtering=True,id=a23e9593-5778-4287-890a-07585622bc27,network=Network(32e04661-5709-44d8-b16f-bc45b62317fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e9593-57')
Apr 14 13:37:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnhPHgQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:37:24 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[1655c6da-e9b0-4003-a8c4-b5d4c6a214f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:37:24 user nova-compute[72019]: No targets found.
Apr 14 13:37:24 user nova-compute[72019]: iSNS:
Apr 14 13:37:24 user nova-compute[72019]: No targets found.
Apr 14 13:37:24 user nova-compute[72019]: STATIC:
Apr 14 13:37:24 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d
Apr 14 13:37:24 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:37:24 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:37:24 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4
Apr 14 13:37:24 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:37:24 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:37:24 user nova-compute[72019]: FIRMWARE:
Apr 14 13:37:24 user nova-compute[72019]: No targets found.
Apr 14 13:37:24 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:37:24 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:37:24 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaefdd3d-9d48-41a0-98ce-a3d4ca8d6722]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[5713b42f-be0f-4b64-8fec-bfdc58def8b7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:37:24 user nova-compute[72019]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:37:24 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 (non-flash)
Apr 14 13:37:24 user nova-compute[72019]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:37:24 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f749cb4a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4'): ({'sdd'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Removing single pathed devices sdd {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c1f448-35b5-4c09-b2ed-639da83fc507]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae0aed4-16c0-44c6-a4eb-3a6453608dcc]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flushing IO for device /dev/sdd {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7ba6c9-ad4c-47a4-90ff-680d537de99a]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.099s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e61e18-77d2-453b-af08-0bfd84ea6740]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] SCSI volumes sdd have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c98f57-7311-47e5-a729-801da87b97a3]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf3b1f7-6981-4599-9eb1-90f28ab57704]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260]
Apr 14 13:37:24 user nova-compute[72019]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4, portal: 172.16.0.220,3260] successful.
Apr 14 13:37:24 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9056cb37-c575-40f0-9cc7-7cd88b944cd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[60698e66-cb86-4af7-8237-f36fdb8264b0]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] <== disconnect_volume: return (385ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:37:24 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Deleting instance files /opt/stack/data/nova/instances/5f323dce-be29-4437-8992-4bfec3ba29ab_del
Apr 14 13:37:24 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Deletion of /opt/stack/data/nova/instances/5f323dce-be29-4437-8992-4bfec3ba29ab_del complete
Apr 14 13:37:24 user nova-compute[72019]: INFO nova.compute.manager [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 14 13:37:24 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:37:24 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-4ae8a1a8-5096-4ebd-8f6a-e8c6c7c18ed7 req-556c004a-10ed-4479-a15f-e089177f066e service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Received event network-vif-deleted-a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:37:25 user nova-compute[72019]: INFO nova.compute.manager [req-4ae8a1a8-5096-4ebd-8f6a-e8c6c7c18ed7 req-556c004a-10ed-4479-a15f-e089177f066e service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Neutron deleted interface a23e9593-5778-4287-890a-07585622bc27; detaching it from the instance and deleting it from the info cache
Apr 14 13:37:25 user nova-compute[72019]: DEBUG nova.network.neutron [req-4ae8a1a8-5096-4ebd-8f6a-e8c6c7c18ed7 req-556c004a-10ed-4479-a15f-e089177f066e service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:37:25 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Took 0.53 seconds to deallocate network for instance.
Apr 14 13:37:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-4ae8a1a8-5096-4ebd-8f6a-e8c6c7c18ed7 req-556c004a-10ed-4479-a15f-e089177f066e service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Detach interface failed, port_id=a23e9593-5778-4287-890a-07585622bc27, reason: Instance 5f323dce-be29-4437-8992-4bfec3ba29ab could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Received event network-vif-unplugged-a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] Acquiring lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] Lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] Lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] No waiting events found dispatching network-vif-unplugged-a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Received event network-vif-unplugged-a23e9593-5778-4287-890a-07585622bc27 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Received event network-vif-plugged-a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] Acquiring lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] Lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] Lock "5f323dce-be29-4437-8992-4bfec3ba29ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG nova.compute.manager [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] No waiting events found dispatching network-vif-plugged-a23e9593-5778-4287-890a-07585622bc27 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:37:25 user nova-compute[72019]: WARNING nova.compute.manager [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Received unexpected event network-vif-plugged-a23e9593-5778-4287-890a-07585622bc27 for instance with vm_state active and task_state deleting.
Apr 14 13:37:25 user nova-compute[72019]: INFO nova.compute.manager [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Took 0.81 seconds to detach 1 volumes for instance.
Apr 14 13:37:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "b64515ec-405b-4d02-9195-3b0efe3b5488" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG nova.compute.manager [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Going to confirm migration 2 {{(pid=72019) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:37:25 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquired lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Building network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG nova.objects.instance [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'info_cache' on Instance uuid b64515ec-405b-4d02-9195-3b0efe3b5488 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:37:26 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Deleted allocations for instance 5f323dce-be29-4437-8992-4bfec3ba29ab
Apr 14 13:37:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "5f323dce-be29-4437-8992-4bfec3ba29ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.978s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG nova.network.neutron [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updating instance_info_cache with network_info: [{"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Releasing lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG nova.objects.instance [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'migration_context' on Instance uuid b64515ec-405b-4d02-9195-3b0efe3b5488 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:37:26 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.243s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:37:27 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Deleted allocation for migration b150cbf6-bc86-40a2-9abf-676cf70f390c
Apr 14 13:37:27 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.201s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:37:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:30 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:37:31 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:37:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:37:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:37 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:37:37 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:37:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:37:37 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:37:37 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:37:38 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updating instance_info_cache with network_info: [{"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:37:38 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:37:38 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:37:38 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:37:39 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479444.0656614, 5f323dce-be29-4437-8992-4bfec3ba29ab => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:37:39 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] VM Stopped (Lifecycle Event)
Apr 14 13:37:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-620174c5-ee07-4513-90bf-86c72e03c897 None None] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:37:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:40 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:37:40 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:37:41 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:37:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:37:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:37:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:37:41 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:37:41 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:37:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:37:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:37:41 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:37:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:37:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:37:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:37:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:37:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:37:42 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:37:42 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:37:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=8489MB free_disk=26.102237701416016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:37:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:37:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:37:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance 03b76423-23ff-4721-8300-b198286c109a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:37:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance fe769254-aa7a-4038-abb6-18628dbcd227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:37:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b64515ec-405b-4d02-9195-3b0efe3b5488 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:37:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:37:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:37:43 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:37:43 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:37:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:37:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:37:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:37:47 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:37:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:37:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:37:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:38:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-04f3bec1-721b-4954-8b9e-ee0aea7c2928 req-31b2fb4d-03ce-4a00-b661-f4d03e4093d9 service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Received event network-changed-5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:38:00 user nova-compute[72019]: DEBUG nova.compute.manager [req-04f3bec1-721b-4954-8b9e-ee0aea7c2928 req-31b2fb4d-03ce-4a00-b661-f4d03e4093d9 service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Refreshing instance network info cache due to event network-changed-5670a4df-018a-4b12-bf37-a1fada7bfe9e. {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 13:38:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-04f3bec1-721b-4954-8b9e-ee0aea7c2928 req-31b2fb4d-03ce-4a00-b661-f4d03e4093d9 service nova] Acquiring lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:38:00 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-04f3bec1-721b-4954-8b9e-ee0aea7c2928 req-31b2fb4d-03ce-4a00-b661-f4d03e4093d9 service nova] Acquired lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:38:00 user nova-compute[72019]: DEBUG nova.network.neutron [req-04f3bec1-721b-4954-8b9e-ee0aea7c2928 req-31b2fb4d-03ce-4a00-b661-f4d03e4093d9 service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Refreshing network info cache for port 5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 13:38:01 user nova-compute[72019]: DEBUG nova.network.neutron [req-04f3bec1-721b-4954-8b9e-ee0aea7c2928 req-31b2fb4d-03ce-4a00-b661-f4d03e4093d9 service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Updated VIF entry in instance network info cache for port 5670a4df-018a-4b12-bf37-a1fada7bfe9e. {{(pid=72019) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 13:38:01 user nova-compute[72019]: DEBUG nova.network.neutron [req-04f3bec1-721b-4954-8b9e-ee0aea7c2928 req-31b2fb4d-03ce-4a00-b661-f4d03e4093d9 service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Updating instance_info_cache with network_info: [{"id": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "address": "fa:16:3e:3e:80:6a", "network": {"id": "a9168d79-fcda-4f76-82db-8993f13bbff3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1548446165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad49f75bbe9461b936963e8dc6c8be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5670a4df-01", "ovs_interfaceid": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:38:01 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-04f3bec1-721b-4954-8b9e-ee0aea7c2928 req-31b2fb4d-03ce-4a00-b661-f4d03e4093d9 service nova] Releasing lock "refresh_cache-03b76423-23ff-4721-8300-b198286c109a" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:38:04 user nova-compute[72019]: INFO nova.compute.manager [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Terminating instance
Apr 14 13:38:04 user nova-compute[72019]: DEBUG nova.compute.manager [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG nova.compute.manager [req-e2eaaa09-9cc8-438e-9c0d-eedd086d365a req-6ca1f5af-657d-4484-b900-efa32d541b9f service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Received event network-vif-unplugged-5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e2eaaa09-9cc8-438e-9c0d-eedd086d365a req-6ca1f5af-657d-4484-b900-efa32d541b9f service nova] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e2eaaa09-9cc8-438e-9c0d-eedd086d365a req-6ca1f5af-657d-4484-b900-efa32d541b9f service nova] Lock "03b76423-23ff-4721-8300-b198286c109a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-e2eaaa09-9cc8-438e-9c0d-eedd086d365a req-6ca1f5af-657d-4484-b900-efa32d541b9f service nova] Lock "03b76423-23ff-4721-8300-b198286c109a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG nova.compute.manager [req-e2eaaa09-9cc8-438e-9c0d-eedd086d365a req-6ca1f5af-657d-4484-b900-efa32d541b9f service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] No waiting events found dispatching network-vif-unplugged-5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG nova.compute.manager [req-e2eaaa09-9cc8-438e-9c0d-eedd086d365a req-6ca1f5af-657d-4484-b900-efa32d541b9f service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Received event network-vif-unplugged-5670a4df-018a-4b12-bf37-a1fada7bfe9e for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:38:04 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: 03b76423-23ff-4721-8300-b198286c109a] Instance destroyed successfully.
Apr 14 13:38:04 user nova-compute[72019]: DEBUG nova.objects.instance [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'resources' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-974413752',display_name='tempest-SnapshotDataIntegrityTests-server-974413752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-974413752',id=43,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSR12YULXM8FktIsw6D48vtD0MlDPkVgXWEj6z/53NfD2oP5/RwVMdTTqlNjMV3Dhgc2epCdqJMfyWAUa9Jl7/2VBBQxV/ej5ckBQg3W9NS3eh/ghhBOuxl3PShD/C2bw==',key_name='tempest-SnapshotDataIntegrityTests-495571124',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ad49f75bbe9461b936963e8dc6c8be5',ramdisk_id='',reservation_id='r-k0pwn57g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1133806652',owner_user_name='tempest-SnapshotDataIntegrityTests-1133806652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:31:29Z,user_data=None,user_id='140e52ed81ba492abc14653240501497',uuid=03b76423-23ff-4721-8300-b198286c109a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "address": "fa:16:3e:3e:80:6a", "network": {"id": "a9168d79-fcda-4f76-82db-8993f13bbff3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1548446165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad49f75bbe9461b936963e8dc6c8be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5670a4df-01", "ovs_interfaceid": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Converting VIF {"id": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "address": "fa:16:3e:3e:80:6a", "network": {"id": "a9168d79-fcda-4f76-82db-8993f13bbff3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1548446165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad49f75bbe9461b936963e8dc6c8be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5670a4df-01", "ovs_interfaceid": "5670a4df-018a-4b12-bf37-a1fada7bfe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:80:6a,bridge_name='br-int',has_traffic_filtering=True,id=5670a4df-018a-4b12-bf37-a1fada7bfe9e,network=Network(a9168d79-fcda-4f76-82db-8993f13bbff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5670a4df-01') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG os_vif [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:80:6a,bridge_name='br-int',has_traffic_filtering=True,id=5670a4df-018a-4b12-bf37-a1fada7bfe9e,network=Network(a9168d79-fcda-4f76-82db-8993f13bbff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5670a4df-01') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5670a4df-01, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:38:04 user nova-compute[72019]: INFO os_vif [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:80:6a,bridge_name='br-int',has_traffic_filtering=True,id=5670a4df-018a-4b12-bf37-a1fada7bfe9e,network=Network(a9168d79-fcda-4f76-82db-8993f13bbff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5670a4df-01')
Apr 14 13:38:04 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Deleting instance files /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a_del
Apr 14 13:38:04 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Deletion of /opt/stack/data/nova/instances/03b76423-23ff-4721-8300-b198286c109a_del complete
Apr 14 13:38:04 user nova-compute[72019]: INFO nova.compute.manager [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 13:38:04 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: 03b76423-23ff-4721-8300-b198286c109a] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:38:04 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 03b76423-23ff-4721-8300-b198286c109a] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:38:05 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: 03b76423-23ff-4721-8300-b198286c109a] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:38:05 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 03b76423-23ff-4721-8300-b198286c109a] Took 0.58 seconds to deallocate network for instance.
Apr 14 13:38:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:38:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:38:05 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:38:05 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:38:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:38:05 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Deleted allocations for instance 03b76423-23ff-4721-8300-b198286c109a
Apr 14 13:38:05 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "03b76423-23ff-4721-8300-b198286c109a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.766s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:38:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-502b28cb-9b16-4107-ae8c-d00071edcdd3 req-88e5b81f-a312-4cba-86ca-72fc303ade5d service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Received event network-vif-plugged-5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:38:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-502b28cb-9b16-4107-ae8c-d00071edcdd3 req-88e5b81f-a312-4cba-86ca-72fc303ade5d service nova] Acquiring lock "03b76423-23ff-4721-8300-b198286c109a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:38:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-502b28cb-9b16-4107-ae8c-d00071edcdd3 req-88e5b81f-a312-4cba-86ca-72fc303ade5d service nova] Lock "03b76423-23ff-4721-8300-b198286c109a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:38:06 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-502b28cb-9b16-4107-ae8c-d00071edcdd3 req-88e5b81f-a312-4cba-86ca-72fc303ade5d service nova] Lock "03b76423-23ff-4721-8300-b198286c109a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:38:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-502b28cb-9b16-4107-ae8c-d00071edcdd3 req-88e5b81f-a312-4cba-86ca-72fc303ade5d service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] No waiting events found dispatching network-vif-plugged-5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:38:06 user nova-compute[72019]: WARNING nova.compute.manager [req-502b28cb-9b16-4107-ae8c-d00071edcdd3 req-88e5b81f-a312-4cba-86ca-72fc303ade5d service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Received unexpected event network-vif-plugged-5670a4df-018a-4b12-bf37-a1fada7bfe9e for instance with vm_state deleted and task_state None.
Apr 14 13:38:06 user nova-compute[72019]: DEBUG nova.compute.manager [req-502b28cb-9b16-4107-ae8c-d00071edcdd3 req-88e5b81f-a312-4cba-86ca-72fc303ade5d service nova] [instance: 03b76423-23ff-4721-8300-b198286c109a] Received event network-vif-deleted-5670a4df-018a-4b12-bf37-a1fada7bfe9e {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:38:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:12 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:19 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479484.8539774, 03b76423-23ff-4721-8300-b198286c109a => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:38:19 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: 03b76423-23ff-4721-8300-b198286c109a] VM Stopped (Lifecycle Event)
Apr 14 13:38:19 user nova-compute[72019]: DEBUG nova.compute.manager [None req-26260816-0a10-4084-8530-9c68f95060ab None None] [instance: 03b76423-23ff-4721-8300-b198286c109a] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:38:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:21 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:38:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:27 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:38:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:38:31 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:38:33 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:38:34 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:38:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:38:38 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:38:39 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:38:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:38:39 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Rebuilding the list of instances to heal {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 13:38:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:38:39 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:38:39 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:38:39 user nova-compute[72019]: DEBUG nova.objects.instance [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lazy-loading 'info_cache' on Instance uuid fe769254-aa7a-4038-abb6-18628dbcd227 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:38:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:38:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:38:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:38:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:38:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:40 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updating instance_info_cache with network_info: [{"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:38:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:38:40 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:38:40 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:38:40 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:38:42 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:38:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:38:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:38:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:38:42 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:38:42 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:38:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:38:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:38:42 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:38:43 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:38:43 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:38:43 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:38:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=8670MB free_disk=26.1114501953125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:38:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:38:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:38:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance fe769254-aa7a-4038-abb6-18628dbcd227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:38:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b64515ec-405b-4d02-9195-3b0efe3b5488 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:38:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:38:43 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=832MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:38:43 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing inventories for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 13:38:43 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Updating ProviderTree inventory for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 13:38:43 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Updating inventory in ProviderTree for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 13:38:43 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing aggregate associations for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569, aggregates: None {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 13:38:43 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing trait associations for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 13:38:43 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:38:43 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:38:44 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:38:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:38:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:38:47 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:38:47 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:38:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:38:50 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:38:50 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72019) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid fe769254-aa7a-4038-abb6-18628dbcd227 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Triggering sync for uuid b64515ec-405b-4d02-9195-3b0efe3b5488 {{(pid=72019) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "fe769254-aa7a-4038-abb6-18628dbcd227" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "fe769254-aa7a-4038-abb6-18628dbcd227" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "b64515ec-405b-4d02-9195-3b0efe3b5488" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "fe769254-aa7a-4038-abb6-18628dbcd227" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:38:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:56 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:38:57 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:38:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:39:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:39:01 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:39:01 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Cleaning up deleted instances {{(pid=72019) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 13:39:01 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] There are 0 instances to clean {{(pid=72019) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 13:39:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:39:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:39:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:39:17 user nova-compute[72019]: INFO nova.compute.manager [None req-7bcf6787-bdc6-4a45-b854-9a7ac0cbb09f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Get console output
Apr 14 13:39:17 user nova-compute[72019]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 14 13:39:17 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:39:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:39:22 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:39:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:39:27 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:39:29 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:39:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:39:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:39:34 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:39:34 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:39:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:39:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:39:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:39:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:39:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:39:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:39:39 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:39:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:39:40 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:39:40 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:39:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:39:40 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:39:40 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:39:41 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updating instance_info_cache with network_info: [{"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:39:41 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-b64515ec-405b-4d02-9195-3b0efe3b5488" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:39:41 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:39:42 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:39:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:39:44 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:39:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:39:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:39:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:39:44 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:39:44 user nova-compute[72019]: DEBUG nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72019) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 13:39:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:39:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:39:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:39:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:39:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:39:45 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:39:45 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:39:45 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=8734MB free_disk=26.110122680664062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:39:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:39:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:39:45 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance fe769254-aa7a-4038-abb6-18628dbcd227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:39:45 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance b64515ec-405b-4d02-9195-3b0efe3b5488 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:39:45 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:39:45 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=832MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:39:45 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:39:45 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:39:45 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:39:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:39:48 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:39:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:39:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:39:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:39:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:39:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:39:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:39:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:39:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:40:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:40:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:40:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:40:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:40:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:40:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:40:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:40:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:40:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "b64515ec-405b-4d02-9195-3b0efe3b5488" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:40:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:40:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:40:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:40:17 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:40:17 user nova-compute[72019]: INFO nova.compute.manager [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Terminating instance
Apr 14 13:40:17 user nova-compute[72019]: DEBUG nova.compute.manager [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-0532bde0-63b9-4211-8420-7fdef6ca12f9 req-ce067ce0-4ed4-433f-a6c6-78b2f4e64b59 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received event network-vif-unplugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0532bde0-63b9-4211-8420-7fdef6ca12f9 req-ce067ce0-4ed4-433f-a6c6-78b2f4e64b59 service nova] Acquiring lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0532bde0-63b9-4211-8420-7fdef6ca12f9 req-ce067ce0-4ed4-433f-a6c6-78b2f4e64b59 service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-0532bde0-63b9-4211-8420-7fdef6ca12f9 req-ce067ce0-4ed4-433f-a6c6-78b2f4e64b59 service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-0532bde0-63b9-4211-8420-7fdef6ca12f9 req-ce067ce0-4ed4-433f-a6c6-78b2f4e64b59 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] No waiting events found dispatching network-vif-unplugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG nova.compute.manager [req-0532bde0-63b9-4211-8420-7fdef6ca12f9 req-ce067ce0-4ed4-433f-a6c6-78b2f4e64b59 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received event network-vif-unplugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:18 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Instance destroyed successfully.
Apr 14 13:40:18 user nova-compute[72019]: DEBUG nova.objects.instance [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'resources' on Instance uuid b64515ec-405b-4d02-9195-3b0efe3b5488 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-403210657',display_name='tempest-ServerActionsTestJSON-server-403210657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-403210657',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:35:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-olbsjqoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:37:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=b64515ec-405b-4d02-9195-3b0efe3b5488,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "address": "fa:16:3e:a2:17:55", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7944161-7d", "ovs_interfaceid": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:17:55,bridge_name='br-int',has_traffic_filtering=True,id=c7944161-7d6c-4fa8-b0b9-a6e2e3c23203,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7944161-7d') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_vif [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:17:55,bridge_name='br-int',has_traffic_filtering=True,id=c7944161-7d6c-4fa8-b0b9-a6e2e3c23203,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7944161-7d') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7944161-7d, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:40:18 user nova-compute[72019]: INFO os_vif [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:17:55,bridge_name='br-int',has_traffic_filtering=True,id=c7944161-7d6c-4fa8-b0b9-a6e2e3c23203,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7944161-7d')
Apr 14 13:40:18 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] calling os-brick to detach iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f749cb7bf10>, {'target_iqn': 'iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXtobSsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 13:40:18 user nova-compute[72019]: WARNING os_brick.initiator.connectors.base [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bf1f26-5e0e-4088-bb67-229fddb292de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 13:40:18 user nova-compute[72019]: No targets found.
Apr 14 13:40:18 user nova-compute[72019]: iSNS:
Apr 14 13:40:18 user nova-compute[72019]: No targets found.
Apr 14 13:40:18 user nova-compute[72019]: STATIC:
Apr 14 13:40:18 user nova-compute[72019]: Target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d
Apr 14 13:40:18 user nova-compute[72019]:         Portal: 172.16.0.220:3260,-1
Apr 14 13:40:18 user nova-compute[72019]:                 Iface Name: default
Apr 14 13:40:18 user nova-compute[72019]: FIRMWARE:
Apr 14 13:40:18 user nova-compute[72019]: No targets found.
Apr 14 13:40:18 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 13:40:18 user nova-compute[72019]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 13:40:18 user nova-compute[72019]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=72019) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d', 0)] {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bc2393-4b63-4963-9bd7-afd519397f4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[786ea3c2-8dad-4fa6-9e5a-9ab2213953c6]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:40:18 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d (non-flash)
Apr 14 13:40:18 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7490794a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d'): ({'sdc'}, set())}) {{(pid=72019) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Removing single pathed devices sdc {{(pid=72019) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffcfe74-0e6f-42b4-a6f9-76582a354b14]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26d1263-2396-496c-8ba1-241a18b82a49]: (4, ('ok\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flushing IO for device /dev/sdc {{(pid=72019) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[252a4bc5-f49a-4978-9522-0f72d80386e7]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72019) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fe367c-c1f3-4a69-b959-9fdb626716c0]: (4, ('1', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.linuxscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] SCSI volumes sdc have been removed. {{(pid=72019) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26134656436373231', '/dev/disk/by-id/scsi-1SCST_BIO3cd0244c-a4ed67219dcd46e8', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3cd0244c') {{(pid=82397) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b789a0-634f-45d8-97fd-7b08abe8aae6]: (4, None) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d')] {{(pid=72019) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd984e6-fe21-4205-9cbe-d9197bf73fc3]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:40:18 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --logout {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:40:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:40:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c97e08-9a00-4dc9-b2b4-c5f58cb80bd9]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:40:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260]
Apr 14 13:40:19 user nova-compute[72019]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d, portal: 172.16.0.220,3260] successful.
Apr 14 13:40:19 user nova-compute[72019]:  stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:40:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op delete {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:40:19 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492fdd47-3fa9-474f-83e3-dfaee2a0c94d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82397) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:40:19 user nova-compute[72019]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c167360-4899-4962-9499-f5a61a3eb4c1]: (4, ('', '')) {{(pid=82397) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 13:40:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72019) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 13:40:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.base [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 13:40:19 user nova-compute[72019]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] <== disconnect_volume: return (288ms) None {{(pid=72019) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 13:40:19 user nova-compute[72019]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Disconnected iSCSI Volume {{(pid=72019) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 13:40:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Deleting instance files /opt/stack/data/nova/instances/b64515ec-405b-4d02-9195-3b0efe3b5488_del
Apr 14 13:40:19 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Deletion of /opt/stack/data/nova/instances/b64515ec-405b-4d02-9195-3b0efe3b5488_del complete
Apr 14 13:40:19 user nova-compute[72019]: INFO nova.compute.manager [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 14 13:40:19 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:40:19 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:40:19 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:40:19 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:40:19 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Took 0.84 seconds to deallocate network for instance.
Apr 14 13:40:20 user nova-compute[72019]: DEBUG nova.compute.manager [req-168b066c-409a-43ef-8452-05982221744d req-2a481e4a-8666-4d15-9419-21db0ff5ec90 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received event network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:40:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-168b066c-409a-43ef-8452-05982221744d req-2a481e4a-8666-4d15-9419-21db0ff5ec90 service nova] Acquiring lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:40:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-168b066c-409a-43ef-8452-05982221744d req-2a481e4a-8666-4d15-9419-21db0ff5ec90 service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:40:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-168b066c-409a-43ef-8452-05982221744d req-2a481e4a-8666-4d15-9419-21db0ff5ec90 service nova] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:40:20 user nova-compute[72019]: DEBUG nova.compute.manager [req-168b066c-409a-43ef-8452-05982221744d req-2a481e4a-8666-4d15-9419-21db0ff5ec90 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] No waiting events found dispatching network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:40:20 user nova-compute[72019]: WARNING nova.compute.manager [req-168b066c-409a-43ef-8452-05982221744d req-2a481e4a-8666-4d15-9419-21db0ff5ec90 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received unexpected event network-vif-plugged-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance with vm_state active and task_state deleting.
Apr 14 13:40:20 user nova-compute[72019]: DEBUG nova.compute.manager [req-168b066c-409a-43ef-8452-05982221744d req-2a481e4a-8666-4d15-9419-21db0ff5ec90 service nova] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Received event network-vif-deleted-c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:40:20 user nova-compute[72019]: INFO nova.compute.manager [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Took 0.94 seconds to detach 1 volumes for instance.
Apr 14 13:40:20 user nova-compute[72019]: DEBUG nova.compute.manager [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Deleting volume: 492fdd47-3fa9-474f-83e3-dfaee2a0c94d {{(pid=72019) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 13:40:20 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:40:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:40:21 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:40:21 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:40:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:40:21 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Deleted allocations for instance b64515ec-405b-4d02-9195-3b0efe3b5488
Apr 14 13:40:21 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "b64515ec-405b-4d02-9195-3b0efe3b5488" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.335s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:40:23 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:28 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:31 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:40:33 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479618.6893604, b64515ec-405b-4d02-9195-3b0efe3b5488 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:40:33 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] VM Stopped (Lifecycle Event)
Apr 14 13:40:33 user nova-compute[72019]: DEBUG nova.compute.manager [None req-b67ac602-7237-4ce4-9290-13693f9f05af None None] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:40:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:40:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:40:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:40:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:40:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:40:33 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:34 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:40:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:40:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:40:38 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:41 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:40:42 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:40:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:40:42 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Rebuilding the list of instances to heal {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 13:40:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 13:40:42 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquired lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 13:40:42 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Forcefully refreshing network info cache for instance {{(pid=72019) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 13:40:42 user nova-compute[72019]: DEBUG nova.objects.instance [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lazy-loading 'info_cache' on Instance uuid fe769254-aa7a-4038-abb6-18628dbcd227 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:40:43 user nova-compute[72019]: DEBUG nova.network.neutron [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updating instance_info_cache with network_info: [{"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:40:43 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Releasing lock "refresh_cache-fe769254-aa7a-4038-abb6-18628dbcd227" {{(pid=72019) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 13:40:43 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updated the network info_cache for instance {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 13:40:43 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:40:44 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:40:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:40:44 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:40:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:40:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:40:44 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:40:44 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:40:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:40:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:40:44 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 13:40:45 user nova-compute[72019]: DEBUG oslo_concurrency.processutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72019) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 13:40:45 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:40:45 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:40:45 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=8797MB free_disk=26.10928726196289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:40:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:40:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:40:45 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Instance fe769254-aa7a-4038-abb6-18628dbcd227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=72019) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 13:40:45 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:40:45 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:40:45 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:40:45 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:40:45 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:40:45 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:40:47 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:40:47 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:40:48 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:40:52 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:53 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:40:58 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:03 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:41:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "fe769254-aa7a-4038-abb6-18628dbcd227" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:41:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "fe769254-aa7a-4038-abb6-18628dbcd227" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:41:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:41:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:41:08 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:41:08 user nova-compute[72019]: INFO nova.compute.manager [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Terminating instance
Apr 14 13:41:08 user nova-compute[72019]: DEBUG nova.compute.manager [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Start destroying the instance on the hypervisor. {{(pid=72019) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 13:41:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-2ccc391f-6048-4b74-b8f6-440bf74837cb req-957155f3-dea5-4828-9449-3e71f0452765 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Received event network-vif-unplugged-08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2ccc391f-6048-4b74-b8f6-440bf74837cb req-957155f3-dea5-4828-9449-3e71f0452765 service nova] Acquiring lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2ccc391f-6048-4b74-b8f6-440bf74837cb req-957155f3-dea5-4828-9449-3e71f0452765 service nova] Lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-2ccc391f-6048-4b74-b8f6-440bf74837cb req-957155f3-dea5-4828-9449-3e71f0452765 service nova] Lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-2ccc391f-6048-4b74-b8f6-440bf74837cb req-957155f3-dea5-4828-9449-3e71f0452765 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] No waiting events found dispatching network-vif-unplugged-08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG nova.compute.manager [req-2ccc391f-6048-4b74-b8f6-440bf74837cb req-957155f3-dea5-4828-9449-3e71f0452765 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Received event network-vif-unplugged-08aca6e2-fbdf-43c4-878a-45558c029e27 for instance with task_state deleting. {{(pid=72019) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:09 user nova-compute[72019]: INFO nova.virt.libvirt.driver [-] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Instance destroyed successfully.
Apr 14 13:41:09 user nova-compute[72019]: DEBUG nova.objects.instance [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'resources' on Instance uuid fe769254-aa7a-4038-abb6-18628dbcd227 {{(pid=72019) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG nova.virt.libvirt.vif [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T13:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-53409261',display_name='tempest-ServerActionsTestJSON-server-53409261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-53409261',id=44,image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow==',key_name='tempest-keypair-267883713',keypairs=<?>,launch_index=0,launched_at=2023-04-14T13:31:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b197f1df57f4dee9757639cf861eb97',ramdisk_id='',reservation_id='r-i6j556h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1929049437',owner_user_name='tempest-ServerActionsTestJSON-1929049437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T13:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9169729edbd04fd5a74d2cffd0aa437f',uuid=fe769254-aa7a-4038-abb6-18628dbcd227,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converting VIF {"id": "08aca6e2-fbdf-43c4-878a-45558c029e27", "address": "fa:16:3e:5b:62:9e", "network": {"id": "0a1c90dc-274e-4aab-a239-6a786eb8d0be", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1832265350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b197f1df57f4dee9757639cf861eb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08aca6e2-fb", "ovs_interfaceid": "08aca6e2-fbdf-43c4-878a-45558c029e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG nova.network.os_vif_util [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:62:9e,bridge_name='br-int',has_traffic_filtering=True,id=08aca6e2-fbdf-43c4-878a-45558c029e27,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08aca6e2-fb') {{(pid=72019) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG os_vif [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:62:9e,bridge_name='br-int',has_traffic_filtering=True,id=08aca6e2-fbdf-43c4-878a-45558c029e27,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08aca6e2-fb') {{(pid=72019) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08aca6e2-fb, bridge=br-int, if_exists=True) {{(pid=72019) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:41:09 user nova-compute[72019]: INFO os_vif [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:62:9e,bridge_name='br-int',has_traffic_filtering=True,id=08aca6e2-fbdf-43c4-878a-45558c029e27,network=Network(0a1c90dc-274e-4aab-a239-6a786eb8d0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08aca6e2-fb')
Apr 14 13:41:09 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Deleting instance files /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227_del
Apr 14 13:41:09 user nova-compute[72019]: INFO nova.virt.libvirt.driver [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Deletion of /opt/stack/data/nova/instances/fe769254-aa7a-4038-abb6-18628dbcd227_del complete
Apr 14 13:41:09 user nova-compute[72019]: INFO nova.compute.manager [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 13:41:09 user nova-compute[72019]: DEBUG oslo.service.loopingcall [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72019) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG nova.compute.manager [-] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Deallocating network for instance {{(pid=72019) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 13:41:09 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] deallocate_for_instance() {{(pid=72019) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 13:41:10 user nova-compute[72019]: DEBUG nova.network.neutron [-] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:41:10 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Took 0.44 seconds to deallocate network for instance.
Apr 14 13:41:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-cd687f3c-09a0-41a4-8530-107b2f2eecc7 req-80670636-13d4-4512-a2eb-9a7acf0a6e79 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Received event network-vif-deleted-08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:41:10 user nova-compute[72019]: INFO nova.compute.manager [req-cd687f3c-09a0-41a4-8530-107b2f2eecc7 req-80670636-13d4-4512-a2eb-9a7acf0a6e79 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Neutron deleted interface 08aca6e2-fbdf-43c4-878a-45558c029e27; detaching it from the instance and deleting it from the info cache
Apr 14 13:41:10 user nova-compute[72019]: DEBUG nova.network.neutron [req-cd687f3c-09a0-41a4-8530-107b2f2eecc7 req-80670636-13d4-4512-a2eb-9a7acf0a6e79 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Updating instance_info_cache with network_info: [] {{(pid=72019) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 13:41:10 user nova-compute[72019]: DEBUG nova.compute.manager [req-cd687f3c-09a0-41a4-8530-107b2f2eecc7 req-80670636-13d4-4512-a2eb-9a7acf0a6e79 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Detach interface failed, port_id=08aca6e2-fbdf-43c4-878a-45558c029e27, reason: Instance fe769254-aa7a-4038-abb6-18628dbcd227 could not be found. {{(pid=72019) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 13:41:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:41:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:41:10 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:41:10 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:41:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.104s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:41:10 user nova-compute[72019]: INFO nova.scheduler.client.report [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Deleted allocations for instance fe769254-aa7a-4038-abb6-18628dbcd227
Apr 14 13:41:10 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "fe769254-aa7a-4038-abb6-18628dbcd227" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.616s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:41:11 user nova-compute[72019]: DEBUG nova.compute.manager [req-8c3bf2f6-9e56-40bd-b651-5bbff2b1d73f req-edcd1ec7-5c32-4cee-af92-8e7a5ae1b2a1 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Received event network-vif-plugged-08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 13:41:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8c3bf2f6-9e56-40bd-b651-5bbff2b1d73f req-edcd1ec7-5c32-4cee-af92-8e7a5ae1b2a1 service nova] Acquiring lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:41:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8c3bf2f6-9e56-40bd-b651-5bbff2b1d73f req-edcd1ec7-5c32-4cee-af92-8e7a5ae1b2a1 service nova] Lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:41:11 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [req-8c3bf2f6-9e56-40bd-b651-5bbff2b1d73f req-edcd1ec7-5c32-4cee-af92-8e7a5ae1b2a1 service nova] Lock "fe769254-aa7a-4038-abb6-18628dbcd227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:41:11 user nova-compute[72019]: DEBUG nova.compute.manager [req-8c3bf2f6-9e56-40bd-b651-5bbff2b1d73f req-edcd1ec7-5c32-4cee-af92-8e7a5ae1b2a1 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] No waiting events found dispatching network-vif-plugged-08aca6e2-fbdf-43c4-878a-45558c029e27 {{(pid=72019) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 13:41:11 user nova-compute[72019]: WARNING nova.compute.manager [req-8c3bf2f6-9e56-40bd-b651-5bbff2b1d73f req-edcd1ec7-5c32-4cee-af92-8e7a5ae1b2a1 service nova] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Received unexpected event network-vif-plugged-08aca6e2-fbdf-43c4-878a-45558c029e27 for instance with vm_state deleted and task_state None.
Apr 14 13:41:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:41:24 user nova-compute[72019]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681479669.6125462, fe769254-aa7a-4038-abb6-18628dbcd227 => Stopped> {{(pid=72019) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 13:41:24 user nova-compute[72019]: INFO nova.compute.manager [-] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] VM Stopped (Lifecycle Event)
Apr 14 13:41:24 user nova-compute[72019]: DEBUG nova.compute.manager [None req-e0a8ef20-1014-4739-8c76-5187be3ae639 None None] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Checking state {{(pid=72019) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 13:41:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:41:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:41:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:41:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:41:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:41:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:41:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:41:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:41:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:41:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:41:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:41:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:41:37 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:41:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:41:41 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:41:44 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:41:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:41:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Rebuilding the list of instances to heal {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 13:41:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Didn't find any instances for network info cache update. {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 13:41:44 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:41:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:41:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:41:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:41:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:41:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:41:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:41:46 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:41:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:41:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:41:46 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:41:46 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:41:47 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:41:47 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:41:47 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=8910MB free_disk=26.128273010253906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:41:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:41:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:41:47 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:41:47 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:41:47 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:41:47 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:41:47 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:41:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:41:48 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:41:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:41:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:41:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:42:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:42:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:42:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:42:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:42:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:42:06 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:08 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:42:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:42:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:42:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:42:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:42:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:42:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:42:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:42:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:42:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:32 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:42:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:36 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:42:37 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:42:38 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:42:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:43 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:42:44 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:42:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:42:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Rebuilding the list of instances to heal {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 13:42:44 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Didn't find any instances for network info cache update. {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 13:42:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:46 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:42:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:42:47 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:42:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:42:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:42:47 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:42:47 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:42:48 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:42:48 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:42:48 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=26.126300811767578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:42:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:42:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:42:48 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:42:48 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:42:48 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:42:48 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:42:48 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:42:48 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:42:49 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:42:49 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:51 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:42:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:42:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:42:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:42:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:42:54 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:42:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:42:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:42:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:42:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:42:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:42:59 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:43:04 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:43:09 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:43:14 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:43:16 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:43:19 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:43:24 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:43:29 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:43:34 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:43:34 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:43:37 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:43:38 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:43:39 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:43:39 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:43:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:43:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:43:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:43:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:43:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:43:44 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:43:45 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:43:46 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:43:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:43:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Rebuilding the list of instances to heal {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 13:43:46 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Didn't find any instances for network info cache update. {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 13:43:48 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:43:48 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:43:49 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:43:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:43:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:43:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:43:49 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:43:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:43:50 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:43:50 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:43:50 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=26.11618423461914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:43:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:43:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:43:50 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:43:50 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:43:50 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing inventories for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 13:43:50 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Updating ProviderTree inventory for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 13:43:50 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Updating inventory in ProviderTree for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 13:43:50 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing aggregate associations for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569, aggregates: None {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 13:43:50 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Refreshing trait associations for resource provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=72019) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 13:43:50 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:43:50 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:43:50 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:43:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:43:51 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:43:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:44:00 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:44:01 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:44:01 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72019) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 13:44:03 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:44:05 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:44:10 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:44:10 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:44:10 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Cleaning up deleted instances {{(pid=72019) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 13:44:10 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] There are 0 instances to clean {{(pid=72019) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 13:44:15 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:44:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:44:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:44:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:44:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:44:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:44:20 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:44:21 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:44:25 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:44:30 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:44:34 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:44:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:44:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:44:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:44:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:44:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:44:35 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:44:37 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:44:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:44:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:44:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:44:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:44:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:44:40 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:44:40 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:44:41 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:44:45 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:44:45 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:44:47 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:44:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Starting heal instance info cache {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 13:44:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Rebuilding the list of instances to heal {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 13:44:47 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Didn't find any instances for network info cache update. {{(pid=72019) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 13:44:48 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:44:48 user nova-compute[72019]: DEBUG nova.compute.manager [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72019) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 13:44:49 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:44:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:44:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:44:49 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:44:49 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Auditing locally available compute resources for user (node: user) {{(pid=72019) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 13:44:50 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:44:50 user nova-compute[72019]: WARNING nova.virt.libvirt.driver [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 13:44:50 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Hypervisor/Node resource view: name=user free_ram=9030MB free_disk=26.113563537597656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72019) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 13:44:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 13:44:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 13:44:50 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:44:50 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 13:44:50 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72019) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 13:44:50 user nova-compute[72019]: DEBUG nova.compute.provider_tree [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed in ProviderTree for provider: 9b2bb118-b0e4-40f8-89f7-8051d0c64569 {{(pid=72019) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 13:44:50 user nova-compute[72019]: DEBUG nova.scheduler.client.report [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Inventory has not changed for provider 9b2bb118-b0e4-40f8-89f7-8051d0c64569 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72019) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 13:44:50 user nova-compute[72019]: DEBUG nova.compute.resource_tracker [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Compute_service record updated for user:user {{(pid=72019) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 13:44:50 user nova-compute[72019]: DEBUG oslo_concurrency.lockutils [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=72019) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 13:44:52 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 13:44:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:44:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 13:44:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72019) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 13:44:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:44:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72019) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 13:44:55 user nova-compute[72019]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72019) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 13:44:55 user nova-compute[72019]: DEBUG oslo_service.periodic_task [None req-3b441610-a2a4-4f67-8751-d5b0086a175c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72019) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}